-- Logs begin at Tue 2021-06-01 05:33:52 UTC, end at Tue 2021-06-01 06:28:14 UTC. --
Jun 01 06:02:46.821128 dv-cinder-793885-1-iscsi systemd[1]: Started Devstack devstack@q-svc.service.
Jun 01 06:02:47.877479 dv-cinder-793885-1-iscsi neutron-server[92017]: Beware of the coming changes in the project packaging
Jun 01 06:02:47.878500 dv-cinder-793885-1-iscsi neutron-server[92017]: https://github.com/svinota/pyroute2/discussions/786
Jun 01 06:02:49.591766 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.common.config [-] Logging enabled!
Jun 01 06:02:49.592501 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev247
Jun 01 06:02:49.592953 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=92017) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
Jun 01 06:02:49.599075 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.common.config [-] Logging enabled!
Jun 01 06:02:49.599433 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev247
Jun 01 06:02:49.599912 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=92017) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
Jun 01 06:02:49.601435 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jun 01 06:02:49.601778 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jun 01 06:02:49.602427 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jun 01 06:02:49.602775 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jun 01 06:02:49.603095 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jun 01 06:02:49.603602 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] allow_bulk                     = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.604102 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] allow_overlapping_ips          = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.604526 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] api_extensions_path            =  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.604930 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] api_paste_config               = api-paste.ini {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.606083 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] api_workers                    = 2 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.606083 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] auth_strategy                  = keystone {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.606504 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] backlog                        = 4096 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.606827 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.607205 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] bind_host                      = 0.0.0.0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.607564 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] bind_port                      = 9696 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.607971 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] client_socket_timeout          = 900 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.608325 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] config_dir                     = [] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.608622 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.608972 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] config_source                  = [] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.609326 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] control_exchange               = neutron {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.609680 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] core_plugin                    = ml2 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.609963 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] debug                          = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.610310 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] default_availability_zones     = [] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.610818 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.611300 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] dhcp_agent_notification        = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.611707 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] dhcp_lease_duration            = 86400 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.612208 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] dns_domain                     = openstacklocal {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.612615 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] enable_traditional_dhcp        = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.613012 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] external_dns_driver            = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.613415 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] filter_validation              = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.613801 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] global_physnet_mtu             = 1500 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.614342 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] host                           = dv-cinder-793885-1-iscsi {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.614710 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] http_retries                   = 3 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.615105 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] instance_format                = [instance: %(uuid)s]  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.615541 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.615973 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ipam_driver                    = internal {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.616348 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ipv6_pd_enabled                = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.616724 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] log_config_append              = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.617103 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.617488 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] log_dir                        = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.617855 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] log_file                       = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.618226 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] log_rotate_interval            = 1 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.618608 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] log_rotate_interval_type       = days {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.618995 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] log_rotation_type              = none {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.619392 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.619706 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.620054 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.621443 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.621927 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.622256 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] max_dns_nameservers            = 5 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.622638 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] max_header_line                = 16384 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.623014 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] max_logfile_count              = 30 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.623385 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] max_logfile_size_mb            = 200 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.623772 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] max_subnet_host_routes         = 20 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.624174 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] network_link_prefix            = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.624562 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.624943 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.625328 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] pagination_max_limit           = -1 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.625698 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] periodic_fuzzy_delay           = 5 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.626066 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] periodic_interval              = 40 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.626429 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] publish_errors                 = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.626800 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] rate_limit_burst               = 0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.627187 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] rate_limit_except_level        = CRITICAL {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.627553 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] rate_limit_interval            = 0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.627999 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] retry_until_window             = 30 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.628371 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] rpc_response_max_timeout       = 600 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.628754 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] rpc_state_report_workers       = 0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.629128 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] rpc_workers                    = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.629503 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] send_events_interval           = 2 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.629906 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.633088 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] setproctitle                   = on {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.633088 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] state_path                     = /opt/stack/data/neutron {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.633088 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] syslog_log_facility            = LOG_USER {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.633088 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] tcp_keepidle                   = 600 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.633088 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] transport_url                  = **** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.633088 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] use_eventlog                   = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.633088 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] use_journal                    = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.634005 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] use_json                       = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.634005 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] use_ssl                        = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.634005 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] use_stderr                     = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.634320 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] use_syslog                     = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.634588 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] vlan_transparent               = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.634955 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] watch_log_file                 = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.635303 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] wsgi_default_pool_size         = 100 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.635642 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] wsgi_keep_alive                = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.636147 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:49.637145 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.637682 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.638077 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] profiler.connection_string     = messaging:// {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.638432 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] profiler.enabled               = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.638794 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] profiler.es_doc_type           = notification {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.639143 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] profiler.es_scroll_size        = 10000 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.639500 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] profiler.es_scroll_time        = 2m {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.639895 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] profiler.filter_error_trace    = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.640433 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] profiler.hmac_keys             = SECRET_KEY {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.640718 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.641081 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] profiler.socket_timeout        = 0.1 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.641456 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy      = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.641817 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.642160 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope      = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.642543 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.642920 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.643293 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.643660 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.644106 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.644512 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.644919 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.645331 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.645761 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] nova.auth_section              = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.646188 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] nova.auth_type                 = password {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.646627 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.647106 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] nova.certfile                  = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.647469 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] nova.collect_timing            = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.647906 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] nova.endpoint_type             = public {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.648297 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] nova.insecure                  = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.648670 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] nova.keyfile                   = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.649046 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] nova.live_migration_events     = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.649433 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] nova.region_name               = RegionOne {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.649812 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] nova.split_loggers             = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.650179 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] nova.timeout                   = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.650569 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] placement.auth_section         = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.650945 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] placement.auth_type            = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.651338 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] placement.cafile               = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.652036 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] placement.certfile             = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.652218 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] placement.collect_timing       = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.652698 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] placement.endpoint_type        = public {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.653117 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] placement.insecure             = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.653500 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] placement.keyfile              = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.653830 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] placement.region_name          = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.654232 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] placement.split_loggers        = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.654602 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] placement.timeout              = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.654995 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ironic.auth_section            = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.655382 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ironic.auth_type               = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.655760 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ironic.cafile                  = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.656208 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ironic.certfile                = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.656595 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ironic.collect_timing          = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.656966 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ironic.connect_retries         = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.657356 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ironic.connect_retry_delay     = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.657730 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ironic.enable_notifications    = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.658100 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ironic.endpoint_override       = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.658472 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ironic.insecure                = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.658839 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ironic.interface               = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.659212 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ironic.keyfile                 = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.659587 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ironic.max_version             = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.660000 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ironic.min_version             = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.660367 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ironic.region_name             = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.660744 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ironic.service_name            = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.661111 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ironic.service_type            = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.661529 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ironic.split_loggers           = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.661955 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ironic.status_code_retries     = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.662281 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.662604 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ironic.timeout                 = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.662931 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ironic.valid_interfaces        = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.663250 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ironic.version                 = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.663652 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.664044 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.664442 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.664820 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.665194 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.665566 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.665938 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.666348 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.666725 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.667105 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.668921 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.668921 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.669233 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.669568 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.669950 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.670325 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.670719 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.671095 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.671482 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.671959 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.672333 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.672728 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.673111 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl      = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.673508 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.673964 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.674358 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.674748 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version =  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.675150 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.675528 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.675989 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.676376 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:49.676684 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jun 01 06:02:49.677026 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=92017) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}}
Jun 01 06:02:50.062698 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=92017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:02:50.063039 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=92017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:02:50.063407 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=92017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:02:50.063976 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.manager [-] Loading core plugin: ml2
Jun 01 06:02:50.520754 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:50.520998 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:50.521232 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:50.522500 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:50.522782 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:50.523051 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:50.565340 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:50.565606 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:50.565876 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:50.581505 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:50.581789 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:50.582053 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:50.617060 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:50.617729 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:50.617729 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:50.661703 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:50.661981 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:50.662237 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:50.924509 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7fe3b3dfeee0> agent after_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:50.924949 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7fe3b3dfeee0> agent after_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:50.925297 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _add_segment_host_mapping_for_segment at 0x7fe3b3dfee50> segment precommit_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:50.925649 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _delete_segments_for_network at 0x7fe3b3dfedc0> network precommit_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:50.926527 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _prevent_segment_delete_with_port_bound at 0x7fe3b3e209d0> segment before_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.117796 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._before_network_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> network before_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.118140 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function DVRDbMixin._delete_mac_associated_with_agent at 0x7fe3b3e520d0> agent before_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.118425 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_net of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> network before_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.118707 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> port before_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.118985 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> port before_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.119306 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> segment precommit_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.119570 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> segment precommit_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.119868 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> segment after_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.120132 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> segment after_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.121459 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> network after_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.121738 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> network precommit_delete 0 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.122063 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._port_provisioned of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> port provisioning_complete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.122342 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_create of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> rbac-policy before_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.122624 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_delete of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> rbac-policy after_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.122901 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._retry_binding_revived_agents of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> agent after_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.123185 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> subnet after_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.124869 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> subnet precommit_delete 0 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.125214 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> rbac-policy before_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.125458 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> rbac-policy before_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.125767 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> segment_host_mapping after_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.126147 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> port after_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.126416 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> port after_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.126682 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> port after_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.126983 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> rbac-policy before_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.127243 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> rbac-policy before_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.127500 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fe3b46f7e80>> rbac-policy before_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.127984 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=92017) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 06:02:51.128220 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=92017) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 06:02:51.128460 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=92017) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 06:02:51.128705 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=92017) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 06:02:51.128949 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=92017) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 06:02:51.129181 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=92017) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 06:02:51.129571 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve']
Jun 01 06:02:51.133152 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1']
Jun 01 06:02:51.138208 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete
Jun 01 06:02:51.142369 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(200, 249)])])
Jun 01 06:02:51.144407 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']
Jun 01 06:02:51.144880 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'])
Jun 01 06:02:51.145223 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan']
Jun 01 06:02:51.145615 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security']
Jun 01 06:02:51.148933 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security']
Jun 01 06:02:51.149318 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security']
Jun 01 06:02:51.149704 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv']
Jun 01 06:02:51.180362 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa']
Jun 01 06:02:51.180753 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.qos.drivers.openvswitch.driver.OVSDriver object at 0x7fe3b3e7f970>> qos_plugin after_init 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.181057 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=92017) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}}
Jun 01 06:02:51.181423 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.logapi.drivers.openvswitch.driver.OVSDriver object at 0x7fe3b3e7f5b0>> logging-plugin after_init 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.182948 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=92017) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}}
Jun 01 06:02:51.183840 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv']
Jun 01 06:02:51.184244 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv']
Jun 01 06:02:51.187932 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7fe3b3d9f0d0>> floatingip before_response 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.188226 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7fe3b3d9f0d0>> port before_response 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.267107 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat'
Jun 01 06:02:51.267349 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete
Jun 01 06:02:51.267576 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve'
Jun 01 06:02:51.267996 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)]
Jun 01 06:02:51.303144 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_db.sqlalchemy.engines [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 01 06:02:51.682625 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.managers [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Initializing driver for type 'gre'
Jun 01 06:02:51.684323 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] gre ID ranges: [(1, 1000)]
Jun 01 06:02:51.753788 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.managers [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Initializing driver for type 'local'
Jun 01 06:02:51.754491 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.managers [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Initializing driver for type 'vlan'
Jun 01 06:02:51.770599 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] VlanTypeDriver initialization complete
Jun 01 06:02:51.771230 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.managers [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Initializing driver for type 'vxlan'
Jun 01 06:02:51.771887 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] vxlan ID ranges: [(1, 1000)]
Jun 01 06:02:51.846749 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.managers [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Initializing extension driver 'port_security'
Jun 01 06:02:51.847127 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.extensions.port_security [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] PortSecurityExtensionDriver initialization complete
Jun 01 06:02:51.847488 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.managers [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Initializing mechanism driver 'openvswitch'
Jun 01 06:02:51.847904 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.managers [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Initializing mechanism driver 'hyperv'
Jun 01 06:02:51.856077 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.plugins.ml2.plugin [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=92017) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:02:51.856982 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe3b3d115e0>> port after_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.857360 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe3b3d115e0>> port after_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.857715 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe3b3d115e0>> port after_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.858109 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe3b3d11850>> subnet after_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.858454 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe3b3d11850>> subnet after_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.858798 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe3b3d11850>> subnet after_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.859180 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe3b37794c0>> network after_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.859530 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe3b37794c0>> network after_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.859906 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe3b37794c0>> network after_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.860289 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe3b3779730>> security_group after_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.860659 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe3b3779730>> security_group after_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.861074 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe3b3779730>> security_group after_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.861457 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe3b37799a0>> security_group_rule after_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.861799 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe3b37799a0>> security_group_rule after_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.862134 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe3b37799a0>> security_group_rule after_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.862513 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe3b3779c10>> address_group after_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.862857 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe3b3779c10>> address_group after_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.863196 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fe3b3779c10>> address_group after_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.863540 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] ML2 OVO RPC backend initialized. {{(pid=92017) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:160}}
Jun 01 06:02:51.864359 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_created of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe3b3779fd0>> router_interface after_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.864713 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_deleted of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe3b3779fd0>> router_interface after_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.865130 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe3b3779fd0>> network before_response 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.865476 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe3b3779fd0>> networks before_response 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.865823 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe3b3779fd0>> port before_response 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.866166 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe3b3779fd0>> ports before_response 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.866508 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe3b3779fd0>> subnet before_response 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.866848 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe3b3779fd0>> subnets before_response 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.867194 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe3b3779fd0>> network after_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.867532 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe3b3779fd0>> network after_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.867899 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe3b3779fd0>> network after_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.868239 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe3b3779fd0>> port after_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.868573 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe3b3779fd0>> port after_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.868904 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe3b3779fd0>> port after_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.869238 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe3b3779fd0>> subnet after_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.869740 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe3b3779fd0>> subnet after_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.870073 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fe3b3779fd0>> subnet after_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.872108 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.plugin [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Modular L2 Plugin initialization complete
Jun 01 06:02:51.872464 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading services supported by the core plugin {{(pid=92017) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}}
Jun 01 06:02:51.872802 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.plugins.ml2.managers [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Got port-security extension from driver 'port_security'
Jun 01 06:02:51.873291 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.extensions.vlantransparent [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Disabled vlantransparent extension.
Jun 01 06:02:51.873792 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=92017) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}}
Jun 01 06:02:51.874112 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading Plugin: router
Jun 01 06:02:51.916238 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DVRResourceOperationHandler._add_csnat_on_interface_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe3b3782160>> router_interface before_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.916553 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._after_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe3b3782160>> router after_create 55549900 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.916923 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._before_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe3b3782160>> router before_create 55549900 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.917962 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe3b3782160>> router_interface before_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.919036 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DVRResourceOperationHandler._cleanup_after_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe3b3782160>> router_interface after_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.919399 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._cleanup_ha_network of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe3b3782160>> router after_delete 55549900 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.919761 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DVRResourceOperationHandler._create_dvr_floating_gw_port of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe3b3782160>> floatingip after_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.920158 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe3b3782160>> router after_create 55549900 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.920508 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe3b3782160>> router after_update 55549900 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.920865 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_distributed_port_bindings_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe3b3782160>> router after_update 55549900 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.921211 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_dvr_internal_ports of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe3b3782160>> router_gateway after_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.921573 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe3b3782160>> router after_update 55549900 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.921986 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DVRResourceOperationHandler._handle_distributed_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe3b3782160>> router precommit_update 55549900 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.922364 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <function L3RpcNotifierMixin._notify_gateway_port_ip_changed at 0x7fe3b3cd2940> port after_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.922697 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <function L3RpcNotifierMixin._notify_routers_callback at 0x7fe3b3cd2a60> port after_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.923031 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnet_gateway_ip_update at 0x7fe3b3cd29d0> subnet after_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.923372 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnetpool_address_scope_update at 0x7fe3b3cd2820> subnetpool_address_scope after_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.923724 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method L3_NAT_dbonly_mixin._precommit_delete_port_callback of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe3b3782160>> port precommit_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.924104 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._precommit_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe3b3782160>> router precommit_create 55549900 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.924449 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback at 0x7fe3b3cca430> port before_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.924793 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method RouterAvailabilityZoneMixin._process_az_request of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe3b3782160>> router precommit_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.925148 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._reconfigure_ha_resources of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe3b3782160>> router after_update 55549900 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.925486 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._release_router_vr_id of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe3b3782160>> router precommit_delete 55549900 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.925830 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DVRResourceOperationHandler._set_distributed_flag of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe3b3782160>> router precommit_create 55549900 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.926188 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe3b3782160>> router_interface after_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.926527 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._validate_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe3b3782160>> router precommit_update 55549900 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.926900 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fe3b3782160>> network after_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.927877 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Tracking information for resource: router configured {{(pid=92017) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 06:02:51.928204 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Tracking information for resource: floatingip configured {{(pid=92017) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 06:02:51.935347 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.db.l3_agentschedulers_db [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled.
Jun 01 06:02:51.935979 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <function _notify_l3_agent_port_update at 0x7fe3b36f7e50> port after_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.936349 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <function _notify_l3_agent_new_port at 0x7fe3b36f7d30> port after_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.936696 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <function _notify_port_delete at 0x7fe3b36f7dc0> port after_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.937043 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <function _notify_l3_agent_ha_port_update at 0x7fe3b36f8160> port after_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.937888 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DriverController._check_router_request of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fe3b3717940>> router before_create 55550100 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.938258 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DriverController._clear_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fe3b3717940>> router precommit_delete 55550100 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.938616 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DriverController._set_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fe3b3717940>> router precommit_create 55550100 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.938967 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method DriverController._update_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fe3b3717940>> router precommit_update 55550100 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.943963 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.services.provider_configuration [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Service providers = [] {{(pid=92017) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}}
Jun 01 06:02:51.944328 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.db.servicetype_db [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=92017) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}}
Jun 01 06:02:51.947611 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.services.service_base [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=92017) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 01 06:02:51.947987 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.services.service_base [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=92017) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 01 06:02:51.948334 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.services.service_base [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=92017) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 01 06:02:51.950823 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.services.service_base [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=92017) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 01 06:02:51.951211 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.services.service_base [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Default provider is not specified for service type L3_ROUTER_NAT
Jun 01 06:02:51.951868 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=92017) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 06:02:51.952302 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin
Jun 01 06:02:51.964151 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=92017) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 06:02:51.965630 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading Plugin: auto_allocate
Jun 01 06:02:51.972301 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7fe3b3745550> network precommit_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.972677 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7fe3b3745550> network precommit_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.973229 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=92017) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 06:02:51.973547 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading Plugin: tag
Jun 01 06:02:51.982029 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=92017) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 06:02:51.982356 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading Plugin: timestamp
Jun 01 06:02:51.986858 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=92017) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 06:02:51.987292 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading Plugin: network_ip_availability
Jun 01 06:02:51.993082 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fe3b3738fa0>> rbac-policy before_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.993454 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fe3b3738fa0>> rbac-policy before_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.993807 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fe3b3738fa0>> rbac-policy before_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:51.994611 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=92017) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 06:02:51.994936 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading Plugin: flavors
Jun 01 06:02:52.001333 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=92017) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 06:02:52.001660 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading Plugin: revisions
Jun 01 06:02:52.006440 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=92017) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 06:02:52.006840 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_concurrency.lockutils [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 1.943s {{(pid=92017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:02:52.007628 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=92017) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}}
Jun 01 06:02:52.007991 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Initializing extension manager.
Jun 01 06:02:52.008534 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: __init__.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.008879 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: __pycache__ {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.009207 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.009535 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: address_group.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.010390 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.011593 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: address-group
Jun 01 06:02:52.012716 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: address_scope.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.013526 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.014063 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: address-scope
Jun 01 06:02:52.014385 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: admin_state_down_before_update.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.015426 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.015980 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: router-admin-state-down-before-update
Jun 01 06:02:52.016304 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: agent.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.017023 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.017539 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: agent
Jun 01 06:02:52.017858 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: agent_resources_synced.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.018811 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.019346 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: agent-resources-synced
Jun 01 06:02:52.019648 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: allowedaddresspairs.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.021674 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.022149 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: allowed-address-pairs
Jun 01 06:02:52.022478 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: auto_allocated_topology.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.023636 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.024195 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: auto-allocated-topology
Jun 01 06:02:52.024514 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: availability_zone.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.025218 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.025734 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: availability_zone
Jun 01 06:02:52.026056 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: availability_zone_filter.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.028392 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.028918 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: availability_zone_filter
Jun 01 06:02:52.029241 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: data_plane_status.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.030180 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.030692 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension data-plane-status not supported by any of loaded plugins
Jun 01 06:02:52.031004 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: default_subnetpools.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.031970 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.032488 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: default-subnetpools
Jun 01 06:02:52.032812 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: dhcpagentscheduler.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.033669 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.034182 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: dhcp_agent_scheduler
Jun 01 06:02:52.034500 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: dns.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.035462 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.036012 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension dns-integration not supported by any of loaded plugins
Jun 01 06:02:52.036329 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: dns_domain_ports.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.037254 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.037764 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension dns-domain-ports not supported by any of loaded plugins
Jun 01 06:02:52.038081 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: dvr.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.038765 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.039280 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: dvr
Jun 01 06:02:52.039599 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: empty_string_filtering.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.040571 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.041086 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: empty-string-filtering
Jun 01 06:02:52.041404 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.043771 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.044551 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins
Jun 01 06:02:52.044933 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.046096 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.046741 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins
Jun 01 06:02:52.047136 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: external_net.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.048223 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.048821 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: external-net
Jun 01 06:02:52.049191 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: extra_dhcp_opt.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.050246 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.050838 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: extra_dhcp_opt
Jun 01 06:02:52.051256 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: extraroute.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.052981 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.053862 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: extraroute
Jun 01 06:02:52.054368 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: extraroute_atomic.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.056394 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.057265 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: extraroute-atomic
Jun 01 06:02:52.057723 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: filter_validation.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.059973 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.060604 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: filter-validation
Jun 01 06:02:52.061011 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: fip_pf_description.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.062358 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.062887 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins
Jun 01 06:02:52.063214 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: fip_port_details.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.064390 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.064925 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: fip-port-details
Jun 01 06:02:52.065247 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: flavors.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.066578 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.067110 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: flavors
Jun 01 06:02:52.067429 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.069239 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.069779 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins
Jun 01 06:02:52.070104 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: floatingip_pools.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.070827 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.071347 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: floatingip-pools
Jun 01 06:02:52.071661 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: ip_allocation.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.072685 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.073200 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension ip_allocation not supported by any of loaded plugins
Jun 01 06:02:52.073577 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.075163 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.075685 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: ip-substring-filtering
Jun 01 06:02:52.076037 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: l2_adjacency.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.077007 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.077521 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension l2_adjacency not supported by any of loaded plugins
Jun 01 06:02:52.077842 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: l3.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.078895 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.079427 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: router
Jun 01 06:02:52.079750 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: l3_conntrack_helper.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.082309 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.082864 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension l3-conntrack-helper not supported by any of loaded plugins
Jun 01 06:02:52.083196 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.084246 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.084786 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: ext-gw-mode
Jun 01 06:02:52.085097 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.086039 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.086560 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: l3-ha
Jun 01 06:02:52.086882 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: l3_flavors.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.087864 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.088390 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: l3-flavors
Jun 01 06:02:52.088708 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.090603 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.091123 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: l3-port-ip-change-not-allowed
Jun 01 06:02:52.091446 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: l3agentscheduler.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.092594 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.093115 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: l3_agent_scheduler
Jun 01 06:02:52.093438 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: logging.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.095042 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.095568 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension logging not supported by any of loaded plugins
Jun 01 06:02:52.095927 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: metering.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.096675 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.097262 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: metering
Jun 01 06:02:52.097582 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.098700 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.099213 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: metering_source_and_destination_fields
Jun 01 06:02:52.099535 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: multiprovidernet.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.100636 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.101154 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: multi-provider
Jun 01 06:02:52.101473 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: netmtu.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.102390 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.102921 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: net-mtu
Jun 01 06:02:52.103221 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: netmtu_writable.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.104198 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.105363 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: net-mtu-writable
Jun 01 06:02:52.106351 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: network_availability_zone.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.107067 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.107594 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: network_availability_zone
Jun 01 06:02:52.107949 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: network_ip_availability.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.109123 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.109638 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: network-ip-availability
Jun 01 06:02:52.109960 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: network_segment_range.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.110757 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.111265 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension network-segment-range not supported by any of loaded plugins
Jun 01 06:02:52.111582 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: pagination.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.112616 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.112964 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: pagination
Jun 01 06:02:52.113264 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: port_device_profile.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.114170 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.114699 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: port-device-profile
Jun 01 06:02:52.115017 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.115969 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.116480 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: port-mac-address-regenerate
Jun 01 06:02:52.116797 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.117706 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.118224 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: port-numa-affinity-policy
Jun 01 06:02:52.118550 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: port_resource_request.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.119472 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.120019 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension port-resource-request not supported by any of loaded plugins
Jun 01 06:02:52.121105 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: portbindings.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.122265 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.122782 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: binding
Jun 01 06:02:52.123098 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: portbindings_extended.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.124466 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.124987 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: binding-extended
Jun 01 06:02:52.125308 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: portsecurity.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.126236 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.126754 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: port-security
Jun 01 06:02:52.127075 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: project_id.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.128084 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.128412 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: project-id
Jun 01 06:02:52.128730 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: providernet.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.129642 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.130169 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: provider
Jun 01 06:02:52.130485 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: qos.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.134226 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.134773 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension qos not supported by any of loaded plugins
Jun 01 06:02:52.135105 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.137682 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.138219 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins
Jun 01 06:02:52.138552 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.139514 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.140068 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins
Jun 01 06:02:52.140394 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: qos_default.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.141310 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.141831 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension qos-default not supported by any of loaded plugins
Jun 01 06:02:52.142156 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: qos_fip.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.142857 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.143368 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension qos-fip not supported by any of loaded plugins
Jun 01 06:02:52.143692 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: qos_gateway_ip.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.144695 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.145219 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension qos-gateway-ip not supported by any of loaded plugins
Jun 01 06:02:52.145537 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: qos_port_network_policy.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.146486 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.146997 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension qos-port-network-policy not supported by any of loaded plugins
Jun 01 06:02:52.147314 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: qos_rule_type_details.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.148272 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.148786 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension qos-rule-type-details not supported by any of loaded plugins
Jun 01 06:02:52.149105 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: qos_rules_alias.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.150204 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.150727 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension qos-rules-alias not supported by any of loaded plugins
Jun 01 06:02:52.151045 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: quotasv2.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.153566 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.153900 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: quotas
Jun 01 06:02:52.154225 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: quotasv2_detail.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.156070 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.156408 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: quota_details
Jun 01 06:02:52.156739 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: rbac.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.157849 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.158414 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: rbac-policies
Jun 01 06:02:52.158742 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: rbac_address_group.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.159738 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.160291 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: rbac-address-group
Jun 01 06:02:52.160614 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: rbac_address_scope.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.161537 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.162053 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: rbac-address-scope
Jun 01 06:02:52.162373 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: rbac_security_groups.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.163283 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.163807 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: rbac-security-groups
Jun 01 06:02:52.164139 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: rbac_subnetpool.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.165059 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.165573 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: rbac-subnetpool
Jun 01 06:02:52.165892 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: revisionifmatch.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.166859 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.168177 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: revision-if-match
Jun 01 06:02:52.168511 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: revisions.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.169692 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.170212 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: standard-attr-revisions
Jun 01 06:02:52.170531 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: router_availability_zone.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.171215 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.171736 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: router_availability_zone
Jun 01 06:02:52.172094 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: routerservicetype.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.173035 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.173551 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension router-service-type not supported by any of loaded plugins
Jun 01 06:02:52.173872 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.174799 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.175316 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: security-groups-normalized-cidr
Jun 01 06:02:52.175637 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: security_groups_port_filtering.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.176615 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.177129 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: port-security-groups-filtering
Jun 01 06:02:52.177450 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.178369 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.178885 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: security-groups-remote-address-group
Jun 01 06:02:52.179204 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: securitygroup.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.190366 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.190951 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: security-group
Jun 01 06:02:52.191283 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: segment.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.192225 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.192747 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension segment not supported by any of loaded plugins
Jun 01 06:02:52.193070 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.194097 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.194620 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins
Jun 01 06:02:52.194938 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: servicetype.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.196139 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.196672 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: service-type
Jun 01 06:02:52.196992 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: sorting.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.198020 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.198906 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: sorting
Jun 01 06:02:52.199419 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: standard_attr_segment.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.200657 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.201201 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension standard-attr-segment not supported by any of loaded plugins
Jun 01 06:02:52.201521 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: standardattrdescription.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.202182 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.202694 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: standard-attr-description
Jun 01 06:02:52.203011 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: stateful_security_group.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.203977 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.204522 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: stateful-security-group
Jun 01 06:02:52.204815 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: stdattrs_common.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.205402 dv-cinder-793885-1-iscsi neutron-server[92017]: WARNING neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py
Jun 01 06:02:52.205721 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.206744 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.207259 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins
Jun 01 06:02:52.207578 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: subnet_onboard.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.208764 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.209288 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: subnet_onboard
Jun 01 06:02:52.209618 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.210568 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.211082 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins
Jun 01 06:02:52.211404 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: subnet_service_types.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.212392 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.212919 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: subnet-service-types
Jun 01 06:02:52.213239 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: subnetallocation.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.214641 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.217053 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: subnet_allocation
Jun 01 06:02:52.217401 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.218249 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.218806 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: subnetpool-prefix-ops
Jun 01 06:02:52.219129 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.220289 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.221072 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins
Jun 01 06:02:52.221394 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: tagging.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.222666 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.223215 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: standard-attr-tag
Jun 01 06:02:52.223540 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: timestamp.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.225003 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.225555 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loaded extension: standard-attr-timestamp
Jun 01 06:02:52.225881 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: trunk.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.227075 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.227578 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension trunk not supported by any of loaded plugins
Jun 01 06:02:52.227943 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: trunk_details.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.228954 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.230324 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension trunk-details not supported by any of loaded plugins
Jun 01 06:02:52.230779 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: uplink_status_propagation.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.232102 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.232776 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension uplink-status-propagation not supported by any of loaded plugins
Jun 01 06:02:52.233095 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Loading extension file: vlantransparent.py {{(pid=92017) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 06:02:52.233790 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=92017) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 06:02:52.234301 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extension vlan-transparent not supported by any of loaded plugins
Jun 01 06:02:52.237016 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Creating instance of TrackedResource for resource:network
Jun 01 06:02:52.237788 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Creating instance of TrackedResource for resource:subnet
Jun 01 06:02:52.239825 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 06:02:52.240522 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Creating instance of TrackedResource for resource:port
Jun 01 06:02:52.241915 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.v2.resource_helper [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92017) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 06:02:52.242357 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.v2.resource_helper [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Service FLAVORS assigned prefix:  {{(pid=92017) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 06:02:52.243004 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.v2.resource_helper [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92017) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 06:02:52.243449 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.v2.resource_helper [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92017) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 06:02:52.243805 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Creating instance of TrackedResource for resource:router
Jun 01 06:02:52.244534 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Creating instance of TrackedResource for resource:floatingip
Jun 01 06:02:52.245346 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.v2.resource_helper [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Service METERING assigned prefix: /metering {{(pid=92017) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 06:02:52.247726 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fe3b36154f0>> rbac-policy before_create 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:52.248125 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fe3b36154f0>> rbac-policy before_update 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:52.248480 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fe3b36154f0>> rbac-policy before_delete 55550000 {{(pid=92017) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:02:52.249813 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Creating instance of CountableResource for resource:rbac_policy
Jun 01 06:02:52.250291 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Creating instance of TrackedResource for resource:security_group
Jun 01 06:02:52.251005 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Creating instance of TrackedResource for resource:security_group_rule
Jun 01 06:02:52.251771 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.v2.resource_helper [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Service CORE assigned prefix:  {{(pid=92017) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 06:02:52.252136 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 06:02:52.252478 dv-cinder-793885-1-iscsi neutron-server[92017]: WARNING neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] subnetpool is already registered
Jun 01 06:02:52.253117 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.v2.resource_helper [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Service CORE assigned prefix:  {{(pid=92017) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 06:02:52.253449 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 06:02:52.253771 dv-cinder-793885-1-iscsi neutron-server[92017]: WARNING neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] subnetpool is already registered
Jun 01 06:02:52.256665 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.v2.resource_helper [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92017) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 06:02:52.257106 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.v2.resource_helper [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Service FLAVORS assigned prefix:  {{(pid=92017) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 06:02:52.257715 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.v2.resource_helper [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92017) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 06:02:52.258138 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.v2.resource_helper [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92017) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 06:02:52.258475 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Creating instance of TrackedResource for resource:router
Jun 01 06:02:52.258808 dv-cinder-793885-1-iscsi neutron-server[92017]: WARNING neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] router is already registered
Jun 01 06:02:52.259458 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Creating instance of TrackedResource for resource:floatingip
Jun 01 06:02:52.259820 dv-cinder-793885-1-iscsi neutron-server[92017]: WARNING neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] floatingip is already registered
Jun 01 06:02:52.260465 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.v2.resource_helper [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Service METERING assigned prefix: /metering {{(pid=92017) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 06:02:52.261963 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Creating instance of CountableResource for resource:rbac_policy
Jun 01 06:02:52.262484 dv-cinder-793885-1-iscsi neutron-server[92017]: WARNING neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] rbac_policy is already registered
Jun 01 06:02:52.263217 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Creating instance of TrackedResource for resource:security_group
Jun 01 06:02:52.263564 dv-cinder-793885-1-iscsi neutron-server[92017]: WARNING neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] security_group is already registered
Jun 01 06:02:52.264245 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Creating instance of TrackedResource for resource:security_group_rule
Jun 01 06:02:52.264584 dv-cinder-793885-1-iscsi neutron-server[92017]: WARNING neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] security_group_rule is already registered
Jun 01 06:02:52.265281 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.v2.resource_helper [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Service CORE assigned prefix:  {{(pid=92017) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 06:02:52.265615 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 06:02:52.265945 dv-cinder-793885-1-iscsi neutron-server[92017]: WARNING neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] subnetpool is already registered
Jun 01 06:02:52.266560 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.v2.resource_helper [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Service CORE assigned prefix:  {{(pid=92017) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 06:02:52.266883 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 06:02:52.267203 dv-cinder-793885-1-iscsi neutron-server[92017]: WARNING neutron.quota.resource_registry [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] subnetpool is already registered
Jun 01 06:02:52.267886 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: extensions {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.269456 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: address-groups {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.271111 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: address-scopes {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.272366 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: agents {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.273535 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: auto-allocated-topology {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.274808 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: availability_zones {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.276188 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: dhcp-networks {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.278744 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: dhcp-agents {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.280221 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: routers {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.282057 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: flavors {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.283224 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: service_profiles {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.284490 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: next_providers {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.286025 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: service_profiles {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.287483 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: floatingip-pools {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.288748 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: routers {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.290668 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: floatingips {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.291903 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: l3-routers {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.293957 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: l3-agents {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.295370 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: metering-labels {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.296783 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: metering-label-rules {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.298325 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: network-ip-availabilities {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.299856 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: bindings {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.301822 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: quotas {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.303480 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: quotas {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.305208 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: rbac-policies {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.306838 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: security-groups {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.308876 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: security-group-rules {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.310545 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: service-providers {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.311928 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: subnetpools {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.314762 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: subnetpools {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.316432 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: tags {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.318348 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: tags {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.442401 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: tags {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.444190 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: tags {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.446188 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: tags {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.448166 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: tags {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.450603 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: tags {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.452864 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: tags {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.454714 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: tags {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.456813 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron.api.extensions [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Extended resource: tags {{(pid=92017) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 06:02:52.463168 dv-cinder-793885-1-iscsi neutron-server[92017]: WARNING keystonemiddleware.auth_token [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True.
Jun 01 06:02:52.469287 dv-cinder-793885-1-iscsi neutron-server[92017]: WARNING keystonemiddleware.auth_token [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Jun 01 06:02:52.478005 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_concurrency.lockutils [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Acquired lock "singleton_lock" {{(pid=92017) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}}
Jun 01 06:02:52.478493 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_concurrency.lockutils [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Releasing lock "singleton_lock" {{(pid=92017) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}}
Jun 01 06:02:52.479164 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO oslo_service.service [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Starting 2 workers
Jun 01 06:02:52.485196 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Started child 92229 {{(pid=92017) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 01 06:02:52.490197 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Started child 92230 {{(pid=92017) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 01 06:02:52.491930 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO neutron.service [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Neutron service started, listening on 0.0.0.0:9696
Jun 01 06:02:52.492584 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Notify callbacks [] for process, before_spawn {{(pid=92017) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:02:52.493932 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:02:52.495676 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO oslo_service.service [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Starting 1 workers
Jun 01 06:02:52.496203 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [-] (92229) wsgi starting up on http://0.0.0.0:9696
Jun 01 06:02:52.500749 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:02:52.501710 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Started child 92231 {{(pid=92017) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 01 06:02:52.502287 dv-cinder-793885-1-iscsi neutron-server[92017]: INFO oslo_service.service [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Starting 1 workers
Jun 01 06:02:52.503139 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [-] (92230) wsgi starting up on http://0.0.0.0:9696
Jun 01 06:02:52.507334 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Started child 92232 {{(pid=92017) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 01 06:02:52.508260 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG neutron_lib.callbacks.manager [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] Notify callbacks [] for process, after_spawn {{(pid=92017) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:02:52.510415 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=92017) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
Jun 01 06:02:52.510643 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jun 01 06:02:52.510801 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jun 01 06:02:52.511099 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jun 01 06:02:52.511587 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jun 01 06:02:52.511900 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jun 01 06:02:52.512571 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.512855 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.513150 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.513377 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.service [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] calling RpcWorker wait() {{(pid=92231) _wait /opt/stack/neutron/neutron/service.py:128}}
Jun 01 06:02:52.514161 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.514161 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.514448 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.514593 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.514775 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.515062 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.515320 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.515489 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.515644 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.515932 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.516173 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.516550 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.516829 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.517091 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.517301 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.service [None req-50001a73-f20d-4f49-87cb-ac3d747076c1 None None] returning from RpcWorker wait() {{(pid=92231) _wait /opt/stack/neutron/neutron/service.py:135}}
Jun 01 06:02:52.517457 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.517604 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.517803 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.518070 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.518317 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.518597 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] debug                          = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.518852 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.519370 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.519608 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.519879 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.520124 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.520386 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:02:52.521207 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.521207 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.521207 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.521207 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.521751 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.521751 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.522006 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.522006 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.522289 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.522495 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.522784 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.523026 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.523541 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] host                           = dv-cinder-793885-1-iscsi {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.523814 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.524083 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.524294 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.524565 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.524814 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.525063 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.525316 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.525566 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.525814 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.526063 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.526294 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.527452 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.527452 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.527755 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.528033 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.528387 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.528684 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:02:52.528843 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.529004 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.529165 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.529311 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.529450 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.529718 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.529868 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.530138 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.530365 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.530586 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.530811 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.531059 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.531311 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.531584 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.531850 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.532093 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.532310 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.532561 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.532821 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.533040 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.533289 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.533524 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.533743 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.533995 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.534215 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.534451 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.534594 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:02:52.534744 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.534877 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.535128 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.535373 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.535643 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.535913 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.536173 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.536412 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.536646 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.536879 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.537152 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.537385 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.537644 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.537905 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.538122 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.538353 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.538592 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.538825 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.539061 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.539283 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.539492 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.539765 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.540029 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.540273 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.540487 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.540730 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.540972 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.541431 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.541706 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.542032 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.543144 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.543500 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.543702 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.544116 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.544352 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.544615 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.544872 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.545202 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.545454 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.545772 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.546041 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.546288 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.546605 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.546882 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.547177 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.547400 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.547643 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.547920 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.548177 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.548522 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.548789 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.549062 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.25/identity {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.549322 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.549543 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.549791 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.550043 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.550257 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.550500 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.550715 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.550983 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.551226 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.551445 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.551686 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.551995 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.552233 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.552484 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.552741 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.552988 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.553223 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.553454 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.553676 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.553922 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.554126 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.554349 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.554851 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.555072 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.555358 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.555614 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.555895 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.556105 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.556323 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.556551 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.556810 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.557036 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.557253 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.557456 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.557708 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.558025 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.558396 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.558810 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.559189 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.559417 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.559662 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.560105 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.560544 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.560937 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.561350 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.561734 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.562137 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.562505 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.562895 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.563284 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.563651 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.564042 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.564434 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.564809 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.565176 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.565567 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.565931 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.566042 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 57336) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:02:52.566377 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.566748 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.567189 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.567674 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.568142 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.568565 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.568997 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.569417 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.569810 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.570279 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.570674 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.571082 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.571478 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.571999 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.572444 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.572885 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.573315 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.573974 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.574598 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.575093 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.575539 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.575992 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.576416 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.576998 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.577456 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.577914 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.578373 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.578818 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.579248 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.579707 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.580205 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.580673 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.581343 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.581800 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.582282 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.582758 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.583195 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.583652 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.584142 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.584633 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.585068 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.585497 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.585912 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.586349 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.586750 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.587216 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.587872 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.588298 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.588701 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.589668 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.590403 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.591034 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.591484 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.591910 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.592375 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.592839 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.593278 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.593750 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.594186 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.594603 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.595048 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.595482 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.25/identity {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.595915 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.596323 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.596737 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.597139 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.597607 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.598011 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.598432 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.598886 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.599307 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.599855 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.600291 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.600711 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.601170 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.601569 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.601993 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.602421 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.602820 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.603135 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [-] 10.222.0.25 "GET / HTTP/1.1" status: 200  len: 253 time: 0.0216646
Jun 01 06:02:52.603414 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.603860 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.604303 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.605374 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.606014 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.606616 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.607097 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.607553 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.608082 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.608550 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.609300 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.609767 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.610224 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.610695 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.611212 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.611695 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.612173 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.612610 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.613051 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.613485 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.613922 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.614367 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.614826 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.615246 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.615956 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.616405 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.617759 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.618281 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.618870 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.620900 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.621584 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.622260 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.622818 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.623271 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.623996 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.624456 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.624905 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.625402 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.625842 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.626284 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.626955 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.627363 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.627769 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.628225 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.628623 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.629105 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.629520 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.629920 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.630337 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.630732 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.631134 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.631543 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.631949 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.632386 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.632532 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:02:52.632920 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.633376 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.633763 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.634162 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.634553 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.634976 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.635445 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.635970 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.636437 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.636863 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.637280 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.637731 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.638147 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.638577 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.639008 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.640119 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.640769 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.641293 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.642618 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.643175 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.643646 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.644152 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.644628 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.645195 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.646449 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.646935 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.647372 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.647893 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.648329 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.648793 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.649328 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.649841 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.650340 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.651480 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.652196 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.652909 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:200:249'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.653397 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.653845 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.654360 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.654942 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.655454 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.655959 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.656429 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.656928 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.657383 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.657827 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.658272 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.658748 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.659459 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.659981 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.660446 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.660936 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.661386 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.661832 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.662261 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.662767 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.663223 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.663671 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.664211 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.664577 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jun 01 06:02:52.665375 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=92017) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
Jun 01 06:02:52.665761 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jun 01 06:02:52.666117 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jun 01 06:02:52.666488 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jun 01 06:02:52.667069 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jun 01 06:02:52.668085 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jun 01 06:02:52.668582 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.669102 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.669540 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.669875 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.670408 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.670796 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.671128 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.671520 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.671883 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.672246 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.672729 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.673106 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.673473 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.673836 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.674230 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.674591 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.674949 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.675308 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.675806 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.676177 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.676539 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.676896 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.677254 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] debug                          = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.677967 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.678390 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.678784 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.679143 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.679776 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.680485 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.680860 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.681215 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.681617 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.683511 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.684773 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.685153 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.685528 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.685924 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.686308 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.686677 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.687044 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.687409 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] host                           = dv-cinder-793885-1-iscsi {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.687774 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.688180 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.688542 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.688929 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.689288 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.689645 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.690001 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.690356 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.690707 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.691080 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.691438 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.691846 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.693118 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.693500 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.693863 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.694242 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.696822 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.697289 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.697714 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.698125 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.699155 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.703503 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.704273 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.704671 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.705051 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.705425 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.705797 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.708362 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.708800 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.709250 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.709612 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.709957 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.710290 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.710621 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.711592 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.713492 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.713975 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.715032 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.715556 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.715879 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.716439 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.716439 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.716757 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.717342 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.717949 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.722035 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.723839 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.723839 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.723839 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.723839 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.723839 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.724560 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.724560 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.724827 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.725004 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.725212 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.725502 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.725784 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.727689 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.728267 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.728736 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.729236 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.730294 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.730604 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.730899 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.731188 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.731678 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.731980 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.732279 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 06:02:52.732783 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.733057 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.733540 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.734057 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.734516 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.737330 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.737903 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.738386 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.738883 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.739179 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.739489 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.739821 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.740178 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.743239 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.743857 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.746364 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.746912 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.747689 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.749576 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.750270 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.751167 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.751966 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.754588 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.755244 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.755883 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.25/identity {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.756872 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.757375 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.757922 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.758407 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.758917 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.763090 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.767842 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.767842 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.767842 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.767842 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.767842 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.767842 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.767842 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.767842 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.768896 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.768896 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.768896 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.768896 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.770188 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.770494 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.770777 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.771048 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.771530 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.772037 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.772513 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.772984 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.773425 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.773894 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.774167 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.774656 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.775102 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.775384 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.775651 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.777811 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.778318 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.778762 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.779231 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.779697 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.780224 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.780687 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.781147 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.781600 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.782034 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.782488 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.782952 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.783423 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.783964 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.784424 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.784869 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.785314 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.785803 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.786240 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.786675 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.788510 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.789058 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.789499 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.789974 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.790422 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.790861 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.791328 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.791845 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.792338 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.792797 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.793266 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.793718 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.794191 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.794642 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.794899 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.795365 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.795860 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.796310 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.796830 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.797297 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.797751 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.798230 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.798662 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.799122 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.799613 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.799922 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.800394 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.800651 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.801136 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.802507 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.802823 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.803273 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.803738 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.804095 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.804698 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.804978 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.805238 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.805716 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.807176 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.807462 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.808030 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.808485 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.808910 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.809373 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.809834 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.810288 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.810739 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.811188 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.811636 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.812125 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.812609 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.812883 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.813154 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.813408 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.813715 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.814156 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.814606 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.815090 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.815348 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.815608 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.815909 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.816354 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.816818 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.817279 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.817713 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.818163 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.25/identity {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.819849 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.820109 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.820560 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.820831 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.821248 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.821508 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.822407 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.822407 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.822407 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.822818 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.822818 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.823063 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.824267 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.824267 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.824535 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.826202 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.826528 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.826817 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.827095 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.827540 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.828009 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.828460 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.828898 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.829164 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.829622 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.830082 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.830505 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.830963 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.831436 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.831894 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.832294 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.832799 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.833194 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.833476 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.833754 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.834037 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.834312 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.834761 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.835196 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.835739 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.836213 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.837486 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.840002 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.840872 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.841325 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.841895 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.842322 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.842611 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.842899 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.843185 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.843465 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.843750 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.845056 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.845517 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.845997 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.846432 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.846870 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.847305 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.847745 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.848936 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.848936 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.848936 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.850463 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.850970 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.852245 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.853144 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.853144 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.853435 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.853804 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.854186 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.854570 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.854930 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.855416 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.855867 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.856260 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.856646 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.857022 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.857530 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.857728 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.857869 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.858386 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.858386 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.858682 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.859083 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.859083 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.859348 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.859729 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.860043 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.860571 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.860571 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.860860 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.861361 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.861361 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.862542 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.862542 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.862542 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.862542 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.862542 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.863354 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.863354 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.863354 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.863671 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.865806 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.865806 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.865806 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.865806 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.865806 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:200:249'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.865806 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.865806 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.865806 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.866637 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.866637 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.866637 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.866637 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.866637 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.867125 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.867125 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.867376 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.868824 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.868824 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.868824 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.868824 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.868824 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.868824 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.869453 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.869453 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.869453 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.869792 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.869792 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.869992 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 06:02:52.870688 dv-cinder-793885-1-iscsi neutron-server[92017]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=92017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jun 01 06:02:52.920605 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:03:08.391064 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3dda789f-3e2b-4001-9602-a05b8a195fba None None] get_active_networks_info from dv-cinder-793885-1-iscsi {{(pid=92231) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}}
Jun 01 06:03:08.572762 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-121559a5-2ebb-4eb9-90a7-7e0bde69abea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318'] for agent, after_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:08.602502 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3dda789f-3e2b-4001-9602-a05b8a195fba None None] No non-hosted networks {{(pid=92231) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}}
Jun 01 06:03:11.188174 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318'] for agent, after_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:11.190738 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:11.191588 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:11.192469 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:11.194325 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:11.197076 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:11.198139 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:11.199079 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:11.200287 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:11.202178 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:11.205250 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:11.206828 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:11.208033 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:11.210238 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7fe3b2a1caf0>, 'Open vSwitch agent', 'dv-cinder-793885-1-iscsi', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:03:11.237444 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7fe3b29758b0>,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-793885-1-iscsi', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:03:12.329447 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b3c6f581-5090-41e0-b189-325cca10505c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318'] for agent, after_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:12.407908 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b0229af0-28c2-4661-a63d-6e1efae729e0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:13.265143 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318'] for agent, after_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:15.334698 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318'] for agent, after_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:16.626919 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 57440) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:03:16.888715 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.db.l3_hamode_db [None req-804ce16a-993c-4a0a-82fb-1e217f999114 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1
Jun 01 06:03:17.027695 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-804ce16a-993c-4a0a-82fb-1e217f999114 None None] Routers set() bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:03:17.027695 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-804ce16a-993c-4a0a-82fb-1e217f999114 None None] Router IDs set() for agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:464}}
Jun 01 06:03:17.484750 dv-cinder-793885-1-iscsi neutron-server[92230]: WARNING oslo_policy.policy [None req-fe9073ec-cfab-4611-98d5-bd20c52c296f admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 06:03:17.485346 dv-cinder-793885-1-iscsi neutron-server[92230]: WARNING oslo_policy.policy [None req-fe9073ec-cfab-4611-98d5-bd20c52c296f admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 06:03:17.707382 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [None req-fe9073ec-cfab-4611-98d5-bd20c52c296f admin admin] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=92230) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 06:03:17.708392 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-fe9073ec-cfab-4611-98d5-bd20c52c296f admin admin] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 1.0803106
Jun 01 06:03:20.380751 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 57454) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:03:20.971180 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-2864b2de-45c7-4de3-a7fc-fae7d9e4cb87 admin admin] Request body: {'subnetpool': {'name': 'shared-default-subnetpool-v4', 'shared': True, 'default_prefixlen': 26, 'is_default': True, 'prefixes': ['172.20.0.0/16']}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:03:21.097608 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.policy [None req-2864b2de-45c7-4de3-a7fc-fae7d9e4cb87 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=92230) register_rules /opt/stack/neutron/neutron/policy.py:73}}
Jun 01 06:03:21.145329 dv-cinder-793885-1-iscsi neutron-server[92230]: WARNING oslo_policy.policy [None req-2864b2de-45c7-4de3-a7fc-fae7d9e4cb87 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 06:03:21.145702 dv-cinder-793885-1-iscsi neutron-server[92230]: WARNING oslo_policy.policy [None req-2864b2de-45c7-4de3-a7fc-fae7d9e4cb87 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 06:03:21.154794 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.quota [None req-2864b2de-45c7-4de3-a7fc-fae7d9e4cb87 admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7fe3b3038be0>.
Jun 01 06:03:21.174181 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-2864b2de-45c7-4de3-a7fc-fae7d9e4cb87 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:03:21.259672 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2864b2de-45c7-4de3-a7fc-fae7d9e4cb87 admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8788499302535', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8788499303136', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8788500210937', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8788500203925', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8788500193961', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8788500187969', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-8063414', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-7907124', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-616486', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-542099'] for rbac-policy, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:21.358535 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2864b2de-45c7-4de3-a7fc-fae7d9e4cb87 admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:21.360663 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-2864b2de-45c7-4de3-a7fc-fae7d9e4cb87 admin admin] 10.222.0.25 "POST /v2.0/subnetpools HTTP/1.1" status: 201  len: 739 time: 0.9786162
Jun 01 06:03:24.346784 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 57468) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:03:24.861926 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Request body: {'network': {'project_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'admin_state_up': True, 'name': 'private', 'tenant_id': 'db8a8dba8ad74c49abcee38bbaec0734'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:03:24.867096 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:03:24.873141 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Usage tracker for resource:network and tenant:db8a8dba8ad74c49abcee38bbaec0734 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:03:24.879071 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:03:24.887466 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:03:24.898968 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Made reservation on behalf of db8a8dba8ad74c49abcee38bbaec0734 for: {'network': 1} {{(pid=92230) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:03:24.902470 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-8110114'] for network, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:24.923881 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:24.941819 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:03:24.946709 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Usage tracker for resource:security_group_rule and tenant:db8a8dba8ad74c49abcee38bbaec0734 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:03:24.954787 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:03:24.965225 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:03:25.094254 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:25.099969 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:25.110431 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:03:25.149515 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] vlan segment allocate from pool success with {'vlan_id': 241, 'physical_network': 'physnet1'}  {{(pid=92230) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 06:03:25.200057 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8788497006309', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:25.201057 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7fe3b3dfee50> segment precommit_create {{(pid=92230) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
Jun 01 06:03:25.201880 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.db.segments_db [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Added segment e59d3672-44cd-4626-8b45-4e6e9f16c259 of type vlan for network 6436dd36-4c6e-429d-a690-e5e157653554
Jun 01 06:03:25.218888 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b387c76b-c755-46da-a39f-929919ab7e02,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:03:25.318996 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:25.319528 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:25.320065 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:25.320560 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:25.321078 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:25.321609 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:25.322129 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:25.322641 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:25.323301 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:25.323819 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:25.324309 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:25.324816 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Tracked resource versions report:
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]: pushed versions:
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]: {   'AddressGroup': {'1.2'},
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:     'ConntrackHelper': {'1.0'},
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:     'Log': {'1.0'},
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:     'Network': {'1.1'},
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:     'Port': {'1.7'},
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:     'PortForwarding': {'1.2'},
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:     'QosPolicy': {'1.8'},
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:     'SecurityGroup': {'1.4'},
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:     'SecurityGroupRule': {'1.2'},
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:     'SubPort': {'1.0'},
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:     'Subnet': {'1.1'},
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:     'Trunk': {'1.1'}}
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]: consumer versions:
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]: {   DHCP agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:     L3 agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:     Metadata agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:     Metering agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:     Open vSwitch agent@dv-cinder-793885-1-iscsi: {   'AddressGroup': '1.2',
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:                                                      'ConntrackHelper': '1.0',
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:                                                      'Log': '1.0',
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:                                                      'Network': '1.1',
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:                                                      'Port': '1.7',
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:                                                      'PortForwarding': '1.2',
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:                                                      'QosPolicy': '1.8',
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:                                                      'SecurityGroup': '1.4',
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:                                                      'SecurityGroupRule': '1.2',
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:                                                      'SubPort': '1.0',
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:                                                      'Subnet': '1.1',
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:                                                      'Trunk': '1.1'}}
Jun 01 06:03:25.326678 dv-cinder-793885-1-iscsi neutron-server[92230]:  {{(pid=92230) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 06:03:25.404557 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.294s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:03:25.407074 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8788496565589'] for network, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:25.466136 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104'] for network, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:25.467770 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:03:25.468568 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:25.474585 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:03:25.600370 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Pushing event updated for resources: {'Network': ['ID=6436dd36-4c6e-429d-a690-e5e157653554,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:03:25.605201 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:03:25.607206 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 849 time: 1.2586999
Jun 01 06:03:25.618237 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Network 6436dd36-4c6e-429d-a690-e5e157653554 details requested by agent ovs-agent-dv-cinder-793885-1-iscsi with host dv-cinder-793885-1-iscsi {{(pid=92231) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 06:03:29.284848 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 57484) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:03:29.912255 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25714da8-2d2e-44b7-82e9-b62614ab85eb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:03:29.913675 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-25714da8-2d2e-44b7-82e9-b62614ab85eb admin admin] 10.222.0.25 "GET /v2.0/networks/6436dd36-4c6e-429d-a690-e5e157653554 HTTP/1.1" status: 200  len: 825 time: 0.6275690
Jun 01 06:03:29.949739 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-0262a17e-3d46-482d-bf44-d8b845cc4ef3 admin admin] 10.222.0.25 "GET /v2.0/subnetpools/2048e394-0c04-43ae-8dab-3a77f4304e7e HTTP/1.1" status: 200  len: 734 time: 0.0266073
Jun 01 06:03:29.959897 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-8a86e0ce-8f42-4ea8-b6f0-1ce667610ee0 admin admin] Request body: {'subnet': {'ip_version': 4, 'subnetpool_id': '2048e394-0c04-43ae-8dab-3a77f4304e7e', 'name': 'private-subnet', 'network_id': '6436dd36-4c6e-429d-a690-e5e157653554', 'gateway_ip': '172.20.0.1', 'tenant_id': 'db8a8dba8ad74c49abcee38bbaec0734'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:03:29.965354 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-8a86e0ce-8f42-4ea8-b6f0-1ce667610ee0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:03:29.970044 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-8a86e0ce-8f42-4ea8-b6f0-1ce667610ee0 admin admin] Usage tracker for resource:subnet and tenant:db8a8dba8ad74c49abcee38bbaec0734 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:03:29.973751 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-8a86e0ce-8f42-4ea8-b6f0-1ce667610ee0 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:03:29.981354 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-8a86e0ce-8f42-4ea8-b6f0-1ce667610ee0 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:03:29.997697 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8a86e0ce-8f42-4ea8-b6f0-1ce667610ee0 admin admin] Made reservation on behalf of db8a8dba8ad74c49abcee38bbaec0734 for: {'subnet': 1} {{(pid=92230) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:03:30.000737 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8a86e0ce-8f42-4ea8-b6f0-1ce667610ee0 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:30.698470 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8a86e0ce-8f42-4ea8-b6f0-1ce667610ee0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099'] for subnet, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:30.706824 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:03:30.818595 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a86e0ce-8f42-4ea8-b6f0-1ce667610ee0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ec67bf67-c746-41d0-8af8-7ecda42bc46f,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:03:30.821093 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a86e0ce-8f42-4ea8-b6f0-1ce667610ee0 admin admin] Checking segment: {'id': 'e59d3672-44cd-4626-8b45-4e6e9f16c259', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 241, 'network_id': '6436dd36-4c6e-429d-a690-e5e157653554'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92230) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:03:30.821549 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a86e0ce-8f42-4ea8-b6f0-1ce667610ee0 admin admin] Network hostable DHCP agents. Network: 6436dd36-4c6e-429d-a690-e5e157653554, hostable agents: ['648832f0-f26e-4e29-ac0d-d97e4a75c6c4'], hosted agents: [] {{(pid=92230) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 06:03:30.833388 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-8a86e0ce-8f42-4ea8-b6f0-1ce667610ee0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:03:30.850992 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a86e0ce-8f42-4ea8-b6f0-1ce667610ee0 admin admin] Network 6436dd36-4c6e-429d-a690-e5e157653554 is scheduled to be hosted by DHCP agent 648832f0-f26e-4e29-ac0d-d97e4a75c6c4 with binding_index 1 {{(pid=92230) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 06:03:30.866119 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-8a86e0ce-8f42-4ea8-b6f0-1ce667610ee0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793885-1-iscsi, 6436dd36-4c6e-429d-a690-e5e157653554) {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:03:30.873083 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a86e0ce-8f42-4ea8-b6f0-1ce667610ee0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:03:30.873933 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8a86e0ce-8f42-4ea8-b6f0-1ce667610ee0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:30.882246 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-806f5369-ac29-431e-a9b3-ca13b5f5718c None None] Network 6436dd36-4c6e-429d-a690-e5e157653554 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:03:30.914061 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-8a86e0ce-8f42-4ea8-b6f0-1ce667610ee0 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 854 time: 0.9578049
Jun 01 06:03:31.433598 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp5012ce77-b332-5f05-8982-a48a8fc8d50e-6436dd36-4c6e-429d-a690-e5e157653554', 'network_id': '6436dd36-4c6e-429d-a690-e5e157653554', 'tenant_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'fixed_ips': [{'subnet_id': 'ec67bf67-c746-41d0-8af8-7ecda42bc46f'}]}} from dv-cinder-793885-1-iscsi. {{(pid=92231) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 06:03:31.436214 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:31.759108 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.db_base_plugin_common [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Allocated IP 172.20.0.2 (6436dd36-4c6e-429d-a690-e5e157653554/ec67bf67-c746-41d0-8af8-7ecda42bc46f/418071d4-b320-4335-a4a6-22ed1a75db92) {{(pid=92231) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:03:32.120908 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Notify callbacks [] for port, precommit_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:32.150001 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Transition to ACTIVE for port object 418071d4-b320-4335-a4a6-22ed1a75db92 will not be triggered until provisioned by entity L2. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:03:32.203093 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Transition to ACTIVE for port object 418071d4-b320-4335-a4a6-22ed1a75db92 will not be triggered until provisioned by entity DHCP. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:03:32.217152 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:32.229475 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:03:32.301046 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Network 6436dd36-4c6e-429d-a690-e5e157653554 is already hosted by enough agents. {{(pid=92231) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:03:32.309009 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.scheduler.base_scheduler [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Resources bound (agent type, host, resource id):  {{(pid=92231) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:03:32.320204 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Received port after_create {{(pid=92231) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:03:32.326941 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Pushing event updated for resources: {'Port': ['ID=418071d4-b320-4335-a4a6-22ed1a75db92,revision_number=1']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:03:32.373396 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:32.373655 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:32.373937 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:32.374253 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:32.374566 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:32.374938 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:32.375250 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:32.375559 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:32.375923 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:32.376233 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:32.376539 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:32.376842 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Tracked resource versions report:
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]: pushed versions:
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]: {   'AddressGroup': {'1.2'},
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:     'ConntrackHelper': {'1.0'},
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:     'Log': {'1.0'},
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:     'Network': {'1.1'},
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:     'Port': {'1.7'},
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:     'PortForwarding': {'1.2'},
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:     'QosPolicy': {'1.8'},
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:     'SecurityGroup': {'1.4'},
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:     'SecurityGroupRule': {'1.2'},
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:     'SubPort': {'1.0'},
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:     'Subnet': {'1.1'},
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:     'Trunk': {'1.1'}}
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]: consumer versions:
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]: {   DHCP agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:     L3 agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:     Metadata agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:     Metering agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:     Open vSwitch agent@dv-cinder-793885-1-iscsi: {   'AddressGroup': '1.2',
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:                                                      'ConntrackHelper': '1.0',
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:                                                      'Log': '1.0',
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:                                                      'Network': '1.1',
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:                                                      'Port': '1.7',
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:                                                      'PortForwarding': '1.2',
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:                                                      'QosPolicy': '1.8',
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:                                                      'SecurityGroup': '1.4',
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:                                                      'SecurityGroupRule': '1.2',
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:                                                      'SubPort': '1.0',
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:                                                      'Subnet': '1.1',
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:                                                      'Trunk': '1.1'}}
Jun 01 06:03:32.377949 dv-cinder-793885-1-iscsi neutron-server[92231]:  {{(pid=92231) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 06:03:32.395840 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:03:32.471968 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Attempting to bind port 418071d4-b320-4335-a4a6-22ed1a75db92 on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:03:32.472581 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Attempting to bind port 418071d4-b320-4335-a4a6-22ed1a75db92 by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': 'e59d3672-44cd-4626-8b45-4e6e9f16c259', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 241, 'network_id': '6436dd36-4c6e-429d-a690-e5e157653554'}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:03:32.473246 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Attempting to bind port 418071d4-b320-4335-a4a6-22ed1a75db92 on network 6436dd36-4c6e-429d-a690-e5e157653554 {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:03:32.486476 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 3, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:03:32.487062 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Checking segment: {'id': 'e59d3672-44cd-4626-8b45-4e6e9f16c259', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 241, 'network_id': '6436dd36-4c6e-429d-a690-e5e157653554'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92231) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:03:32.487862 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:32.488472 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Bound using segment: {'id': 'e59d3672-44cd-4626-8b45-4e6e9f16c259', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 241, 'network_id': '6436dd36-4c6e-429d-a690-e5e157653554'} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:03:32.489314 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Bound port: 418071d4-b320-4335-a4a6-22ed1a75db92, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e59d3672-44cd-4626-8b45-4e6e9f16c259', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 241, 'network_id': '6436dd36-4c6e-429d-a690-e5e157653554'}}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:03:32.489919 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:32.651554 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] For port 418071d4-b320-4335-a4a6-22ed1a75db92, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92231) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:03:32.655726 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] For port 418071d4-b320-4335-a4a6-22ed1a75db92, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=418071d4-b320-4335-a4a6-22ed1a75db92,segment=NetworkSegment(e59d3672-44cd-4626-8b45-4e6e9f16c259),segment_id=e59d3672-44cd-4626-8b45-4e6e9f16c259)] {{(pid=92231) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:03:32.663916 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:32.670568 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:03:32.840470 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Pushing event updated for resources: {'Port': ['ID=418071d4-b320-4335-a4a6-22ed1a75db92,revision_number=2']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:03:32.845593 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:03:34.226993 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 57494) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:03:34.889156 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [None req-5e3b5c36-908b-4d14-adcd-257fd12f1c36 admin admin] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=92230) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 06:03:34.900453 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-5e3b5c36-908b-4d14-adcd-257fd12f1c36 admin admin] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.6710694
Jun 01 06:03:38.006075 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 57504) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:03:38.307477 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-86c2228a-35e5-434c-aaec-5c68ac219fcf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:38.990746 dv-cinder-793885-1-iscsi neutron-server[92229]: WARNING oslo_policy.policy [None req-54c73e01-8fc4-470f-9af4-853046f31ce0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 06:03:38.991317 dv-cinder-793885-1-iscsi neutron-server[92229]: WARNING oslo_policy.policy [None req-54c73e01-8fc4-470f-9af4-853046f31ce0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 06:03:39.213039 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [None req-54c73e01-8fc4-470f-9af4-853046f31ce0 admin admin] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=92229) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 06:03:39.214756 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-54c73e01-8fc4-470f-9af4-853046f31ce0 admin admin] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 1.2065492
Jun 01 06:03:40.214398 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-29b04d65-ab48-47e8-8c0e-df748ad361fd None None] Network 6436dd36-4c6e-429d-a690-e5e157653554 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:03:40.355846 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-c3be150d-b887-4276-86f8-376260261e9e None None] Provisioning for port 418071d4-b320-4335-a4a6-22ed1a75db92 completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:03:40.826303 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 418071d4-b320-4335-a4a6-22ed1a75db92 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:03:40.914875 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port 418071d4-b320-4335-a4a6-22ed1a75db92 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:03:40.922549 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 418071d4-b320-4335-a4a6-22ed1a75db92 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:03:40.922981 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:41.071258 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:41.115385 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port 418071d4-b320-4335-a4a6-22ed1a75db92, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=418071d4-b320-4335-a4a6-22ed1a75db92,segment=NetworkSegment(e59d3672-44cd-4626-8b45-4e6e9f16c259),segment_id=e59d3672-44cd-4626-8b45-4e6e9f16c259)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:03:41.120562 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:41.123110 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:03:41.218234 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:41.241489 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=418071d4-b320-4335-a4a6-22ed1a75db92,revision_number=3']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:03:41.248494 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:03:42.322446 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-273345f2-3292-4edd-914b-5d16614bdc3b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:42.616079 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 57534) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:03:42.798460 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 418071d4-b320-4335-a4a6-22ed1a75db92 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:03:42.913947 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 418071d4-b320-4335-a4a6-22ed1a75db92 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:03:42.914454 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:43.027719 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-5a6e3713-12a3-41e6-921a-1ba537a1e517 admin admin] Request body: {'router': {'admin_state_up': True, 'tenant_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'name': 'router1'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:03:43.105650 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.policy [None req-5a6e3713-12a3-41e6-921a-1ba537a1e517 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=92229) register_rules /opt/stack/neutron/neutron/policy.py:73}}
Jun 01 06:03:43.170772 dv-cinder-793885-1-iscsi neutron-server[92229]: WARNING oslo_policy.policy [None req-5a6e3713-12a3-41e6-921a-1ba537a1e517 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 06:03:43.171312 dv-cinder-793885-1-iscsi neutron-server[92229]: WARNING oslo_policy.policy [None req-5a6e3713-12a3-41e6-921a-1ba537a1e517 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 06:03:43.187526 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.quota [None req-5a6e3713-12a3-41e6-921a-1ba537a1e517 admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7fe3b30eda60>.
Jun 01 06:03:43.199282 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:43.211622 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-5a6e3713-12a3-41e6-921a-1ba537a1e517 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:03:43.222509 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-5a6e3713-12a3-41e6-921a-1ba537a1e517 admin admin] Usage tracker for resource:router and tenant:db8a8dba8ad74c49abcee38bbaec0734 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:03:43.228688 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-5a6e3713-12a3-41e6-921a-1ba537a1e517 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:03:43.239321 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-5a6e3713-12a3-41e6-921a-1ba537a1e517 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:03:43.262275 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-5a6e3713-12a3-41e6-921a-1ba537a1e517 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-748217', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-677'] for router, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:43.265253 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-5a6e3713-12a3-41e6-921a-1ba537a1e517 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-749241', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-745574', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-726667', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-686'] for router, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:43.307014 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-5a6e3713-12a3-41e6-921a-1ba537a1e517 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:43.536158 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-5a6e3713-12a3-41e6-921a-1ba537a1e517 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-748208', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-745472'] for router, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:43.568361 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-5a6e3713-12a3-41e6-921a-1ba537a1e517 admin admin] Notify callbacks [] for router, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:43.570734 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-5a6e3713-12a3-41e6-921a-1ba537a1e517 admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201  len: 709 time: 0.9528766
Jun 01 06:03:45.268083 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:46.350480 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 57556) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:03:46.459568 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [None req-fead2992-0358-44f6-9b48-530ea84ae9ec admin admin] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=92229) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 06:03:46.461018 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-fead2992-0358-44f6-9b48-530ea84ae9ec admin admin] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.1091709
Jun 01 06:03:49.113248 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 57566) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:03:49.178685 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Request body: {'network': {'provider:physical_network': 'physnet1', 'router:external': True, 'admin_state_up': True, 'name': 'public', 'provider:network_type': 'flat', 'is_default': True}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:03:49.189074 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:03:49.195320 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Usage tracker for resource:network and tenant:6b216b27f15f4031970c8130e572d869 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:03:49.201339 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:03:49.211595 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:03:49.226534 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Made reservation on behalf of 6b216b27f15f4031970c8130e572d869 for: {'network': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:03:49.231356 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-8110114'] for network, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:49.254646 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:49.274160 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:03:49.279479 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Usage tracker for resource:security_group_rule and tenant:6b216b27f15f4031970c8130e572d869 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:03:49.283651 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:03:49.293439 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:03:49.428921 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:49.434457 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:49.440563 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:03:49.458472 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Reserving flat network on physical network physnet1 {{(pid=92229) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}}
Jun 01 06:03:49.492482 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8788497006309', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:49.493161 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7fe3b3dfee50> segment precommit_create {{(pid=92229) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
Jun 01 06:03:49.493611 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.db.segments_db [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Added segment ad0428a0-0215-4be6-940c-57ddf2bfce55 of type flat for network 83b812fb-2cfc-46e4-baa4-745218ea3ed2
Jun 01 06:03:49.552007 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d14f0c4c-4fe6-4e0a-89ac-ee69c8658fae,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:03:49.584290 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:49.584806 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:49.585166 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:49.585803 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:49.586680 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:49.587193 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:49.587889 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:49.589409 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:49.590109 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:49.590532 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:49.590997 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:49.591507 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Tracked resource versions report:
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]: pushed versions:
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]: {   'AddressGroup': {'1.2'},
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:     'ConntrackHelper': {'1.0'},
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:     'Log': {'1.0'},
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:     'Network': {'1.1'},
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:     'Port': {'1.7'},
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:     'PortForwarding': {'1.2'},
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:     'QosPolicy': {'1.8'},
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:     'SecurityGroup': {'1.4'},
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:     'SecurityGroupRule': {'1.2'},
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:     'SubPort': {'1.0'},
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:     'Subnet': {'1.1'},
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:     'Trunk': {'1.1'}}
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]: consumer versions:
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]: {   DHCP agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:     L3 agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:     Metadata agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:     Metering agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:     Open vSwitch agent@dv-cinder-793885-1-iscsi: {   'AddressGroup': '1.2',
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:                                                      'ConntrackHelper': '1.0',
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:                                                      'Log': '1.0',
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:                                                      'Network': '1.1',
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:                                                      'Port': '1.7',
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:                                                      'PortForwarding': '1.2',
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:                                                      'QosPolicy': '1.8',
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:                                                      'SecurityGroup': '1.4',
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:                                                      'SecurityGroupRule': '1.2',
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:                                                      'SubPort': '1.0',
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:                                                      'Subnet': '1.1',
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:                                                      'Trunk': '1.1'}}
Jun 01 06:03:49.592870 dv-cinder-793885-1-iscsi neutron-server[92229]:  {{(pid=92229) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 06:03:49.682532 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8788496565589'] for network, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:49.693950 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.253s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:03:49.779442 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104'] for network, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:49.781745 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:03:49.782631 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:49.788859 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:03:49.924844 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Pushing event updated for resources: {'Network': ['ID=83b812fb-2cfc-46e4-baa4-745218ea3ed2,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:03:49.940966 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 0.8260412
Jun 01 06:03:49.942501 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 details requested by agent ovs-agent-dv-cinder-793885-1-iscsi with host dv-cinder-793885-1-iscsi {{(pid=92231) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 06:03:49.943219 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:03:52.438309 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 57580) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:03:52.584468 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b924d6a3-3234-4ade-8f29-983c2febbe3c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:03:52.585924 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-b924d6a3-3234-4ade-8f29-983c2febbe3c admin admin] 10.222.0.25 "GET /v2.0/subnets/ec67bf67-c746-41d0-8af8-7ecda42bc46f HTTP/1.1" status: 200  len: 849 time: 0.1463449
Jun 01 06:03:52.798806 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-c4476dd4-f700-4c5a-89d4-0759fd65ff2e admin admin] 10.222.0.25 "GET /v2.0/routers/35591c5a-3d65-4653-abf8-e7dcd08e5935 HTTP/1.1" status: 200  len: 704 time: 0.2060156
Jun 01 06:03:53.540300 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:53.893919 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] Allocated IP 172.20.0.1 (6436dd36-4c6e-429d-a690-e5e157653554/ec67bf67-c746-41d0-8af8-7ecda42bc46f/142ff5c4-5f00-4fd7-92f7-8d443666fad6) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:03:54.119034 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:54.145497 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] Transition to ACTIVE for port object 142ff5c4-5f00-4fd7-92f7-8d443666fad6 will not be triggered until provisioned by entity DHCP. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:03:54.220798 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:54.227643 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:03:54.318687 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] Network 6436dd36-4c6e-429d-a690-e5e157653554 is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:03:54.323916 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:03:54.334025 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:03:54.334636 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-744049'] for router_interface, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:54.597902 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] Pushing event updated for resources: {'Port': ['ID=142ff5c4-5f00-4fd7-92f7-8d443666fad6,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:03:54.620284 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-b678c347-606e-46ad-b58f-1ca99c99886b None None] Provisioning for port 142ff5c4-5f00-4fd7-92f7-8d443666fad6 completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:03:54.622128 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.394s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:03:54.630622 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-b678c347-606e-46ad-b58f-1ca99c99886b None None] Provisioning complete for port 142ff5c4-5f00-4fd7-92f7-8d443666fad6 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:03:54.632172 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b678c347-606e-46ad-b58f-1ca99c99886b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:54.723323 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-b678c347-606e-46ad-b58f-1ca99c99886b None None] Port 142ff5c4-5f00-4fd7-92f7-8d443666fad6 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:03:54.848041 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:55.126330 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:55.131583 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:55.132983 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-582666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-744156'] for router_interface, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:55.137728 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:03:55.287241 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] Pushing event updated for resources: {'Port': ['ID=142ff5c4-5f00-4fd7-92f7-8d443666fad6,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:03:55.292757 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:03:55.370647 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] Network 6436dd36-4c6e-429d-a690-e5e157653554 is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:03:55.371896 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:03:55.599582 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] Router 35591c5a-3d65-4653-abf8-e7dcd08e5935 is scheduled to L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 with binding_index 1 {{(pid=92229) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 06:03:55.659032 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-8ad60188-179c-42f7-90a1-4d8cb6871573 None None] Provisioning complete for port 142ff5c4-5f00-4fd7-92f7-8d443666fad6 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:03:55.659907 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-8ad60188-179c-42f7-90a1-4d8cb6871573 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:55.736640 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-8ad60188-179c-42f7-90a1-4d8cb6871573 None None] Port 142ff5c4-5f00-4fd7-92f7-8d443666fad6 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:03:55.788461 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92229) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:03:55.799466 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] 10.222.0.25 "PUT /v2.0/routers/35591c5a-3d65-4653-abf8-e7dcd08e5935/add_router_interface HTTP/1.1" status: 200  len: 508 time: 2.9934146
Jun 01 06:03:55.803970 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] Sync routers for ids ['35591c5a-3d65-4653-abf8-e7dcd08e5935'] in dv-cinder-793885-1-iscsi {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:03:55.824426 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] Routers {'35591c5a-3d65-4653-abf8-e7dcd08e5935'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:03:55.825701 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b32e3280>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:03:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['35591c5a-3d65-4653-abf8-e7dcd08e5935'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:03:56.058373 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] Set router 35591c5a-3d65-4653-abf8-e7dcd08e5935 gateway port host: None {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:03:56.647609 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b32e3280>, [{'id': '35591c5a-3d65-4653-abf8-e7dcd08e5935', 'name': 'router1', 'tenant_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:03:43Z', 'updated_at': '2021-06-01T06:03:54Z', 'revision_number': 2, 'project_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'gw_port_host': None, '_interfaces': [{'id': '142ff5c4-5f00-4fd7-92f7-8d443666fad6', 'name': '', 'network_id': '6436dd36-4c6e-429d-a690-e5e157653554', 'tenant_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'mac_address': 'fa:16:3e:66:64:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '35591c5a-3d65-4653-abf8-e7dcd08e5935', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ec67bf67-c746-41d0-8af8-7ecda42bc46f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:03:53Z', 'updated_at': '2021-06-01T06:03:54Z', 'revision_number': 2, 'project_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'subnets': [{'id': 'ec67bf67-c746-41d0-8af8-7ecda42bc46f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2048e394-0c04-43ae-8dab-3a77f4304e7e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:03:56.656979 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] Checking router: 35591c5a-3d65-4653-abf8-e7dcd08e5935 for host: dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:03:56.657520 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] Updating router 35591c5a-3d65-4653-abf8-e7dcd08e5935 port 142ff5c4-5f00-4fd7-92f7-8d443666fad6 binding host dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 06:03:56.756265 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:57.379646 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] Notify callbacks [] for port, precommit_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:57.401830 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.provisioning_blocks [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] Transition to ACTIVE for port object 142ff5c4-5f00-4fd7-92f7-8d443666fad6 will not be triggered until provisioned by entity L2. {{(pid=92232) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:03:57.412218 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:57.422368 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:03:57.811260 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28c041af-f2bc-4f42-847f-46efbfd31274 None None] Pushing event updated for resources: {'Port': ['ID=142ff5c4-5f00-4fd7-92f7-8d443666fad6,revision_number=3']} {{(pid=92232) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:03:57.869846 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28c041af-f2bc-4f42-847f-46efbfd31274 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:57.870348 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28c041af-f2bc-4f42-847f-46efbfd31274 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:57.870681 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28c041af-f2bc-4f42-847f-46efbfd31274 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:57.871006 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28c041af-f2bc-4f42-847f-46efbfd31274 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:57.871322 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28c041af-f2bc-4f42-847f-46efbfd31274 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:57.871651 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28c041af-f2bc-4f42-847f-46efbfd31274 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:57.871946 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28c041af-f2bc-4f42-847f-46efbfd31274 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:57.872259 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28c041af-f2bc-4f42-847f-46efbfd31274 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:57.872572 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28c041af-f2bc-4f42-847f-46efbfd31274 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:57.872875 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28c041af-f2bc-4f42-847f-46efbfd31274 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:57.873175 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28c041af-f2bc-4f42-847f-46efbfd31274 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:57.873472 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28c041af-f2bc-4f42-847f-46efbfd31274 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28c041af-f2bc-4f42-847f-46efbfd31274 None None] Tracked resource versions report:
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]: pushed versions:
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]: {   'AddressGroup': {'1.2'},
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:     'ConntrackHelper': {'1.0'},
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:     'Log': {'1.0'},
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:     'Network': {'1.1'},
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:     'Port': {'1.7'},
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:     'PortForwarding': {'1.2'},
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:     'QosPolicy': {'1.8'},
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:     'SecurityGroup': {'1.4'},
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:     'SecurityGroupRule': {'1.2'},
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:     'SubPort': {'1.0'},
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:     'Subnet': {'1.1'},
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:     'Trunk': {'1.1'}}
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]: consumer versions:
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]: {   DHCP agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:     L3 agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:     Metadata agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:     Metering agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:     Open vSwitch agent@dv-cinder-793885-1-iscsi: {   'AddressGroup': '1.2',
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:                                                      'ConntrackHelper': '1.0',
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:                                                      'Log': '1.0',
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:                                                      'Network': '1.1',
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:                                                      'Port': '1.7',
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:                                                      'PortForwarding': '1.2',
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:                                                      'QosPolicy': '1.8',
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:                                                      'SecurityGroup': '1.4',
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:                                                      'SecurityGroupRule': '1.2',
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:                                                      'SubPort': '1.0',
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:                                                      'Subnet': '1.1',
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:                                                      'Trunk': '1.1'}}
Jun 01 06:03:57.874657 dv-cinder-793885-1-iscsi neutron-server[92232]:  {{(pid=92232) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 06:03:57.884509 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] Attempting to bind port 142ff5c4-5f00-4fd7-92f7-8d443666fad6 on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:03:57.884509 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] Attempting to bind port 142ff5c4-5f00-4fd7-92f7-8d443666fad6 by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': 'e59d3672-44cd-4626-8b45-4e6e9f16c259', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 241, 'network_id': '6436dd36-4c6e-429d-a690-e5e157653554'}] {{(pid=92232) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:03:57.884509 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] Attempting to bind port 142ff5c4-5f00-4fd7-92f7-8d443666fad6 on network 6436dd36-4c6e-429d-a690-e5e157653554 {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:03:57.887511 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-28c041af-f2bc-4f42-847f-46efbfd31274 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.464s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:03:57.893768 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 3, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:03:57.894417 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] Checking segment: {'id': 'e59d3672-44cd-4626-8b45-4e6e9f16c259', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 241, 'network_id': '6436dd36-4c6e-429d-a690-e5e157653554'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92232) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:03:57.895100 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:57.895692 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] Bound using segment: {'id': 'e59d3672-44cd-4626-8b45-4e6e9f16c259', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 241, 'network_id': '6436dd36-4c6e-429d-a690-e5e157653554'} {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:03:57.896292 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] Bound port: 142ff5c4-5f00-4fd7-92f7-8d443666fad6, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e59d3672-44cd-4626-8b45-4e6e9f16c259', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 241, 'network_id': '6436dd36-4c6e-429d-a690-e5e157653554'}}] {{(pid=92232) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:03:57.896676 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:58.043104 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.db [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] For port 142ff5c4-5f00-4fd7-92f7-8d443666fad6, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92232) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:03:58.051692 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.db [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] For port 142ff5c4-5f00-4fd7-92f7-8d443666fad6, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=142ff5c4-5f00-4fd7-92f7-8d443666fad6,segment=NetworkSegment(e59d3672-44cd-4626-8b45-4e6e9f16c259),segment_id=e59d3672-44cd-4626-8b45-4e6e9f16c259)] {{(pid=92232) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:03:58.060317 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:58.067861 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-28c041af-f2bc-4f42-847f-46efbfd31274 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:03:58.229102 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] Routers {'35591c5a-3d65-4653-abf8-e7dcd08e5935'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:03:58.230105 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b32e3280>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:03:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['35591c5a-3d65-4653-abf8-e7dcd08e5935'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:03:58.434621 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28c041af-f2bc-4f42-847f-46efbfd31274 None None] Pushing event updated for resources: {'Port': ['ID=142ff5c4-5f00-4fd7-92f7-8d443666fad6,revision_number=4']} {{(pid=92232) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:03:58.459271 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-28c041af-f2bc-4f42-847f-46efbfd31274 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.391s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:03:58.506103 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] Set router 35591c5a-3d65-4653-abf8-e7dcd08e5935 gateway port host: None {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:03:58.980479 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 57592) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:03:58.998351 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b32e3280>, [{'id': '35591c5a-3d65-4653-abf8-e7dcd08e5935', 'name': 'router1', 'tenant_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:03:43Z', 'updated_at': '2021-06-01T06:03:54Z', 'revision_number': 2, 'project_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'gw_port_host': None, '_interfaces': [{'id': '142ff5c4-5f00-4fd7-92f7-8d443666fad6', 'name': '', 'network_id': '6436dd36-4c6e-429d-a690-e5e157653554', 'tenant_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'mac_address': 'fa:16:3e:66:64:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '35591c5a-3d65-4653-abf8-e7dcd08e5935', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ec67bf67-c746-41d0-8af8-7ecda42bc46f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:03:53Z', 'updated_at': '2021-06-01T06:03:58Z', 'revision_number': 4, 'project_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'subnets': [{'id': 'ec67bf67-c746-41d0-8af8-7ecda42bc46f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2048e394-0c04-43ae-8dab-3a77f4304e7e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:03:59.003151 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c988d5e-cb13-442e-9b57-dcddef9653a3 None None] The sync data for ids ['35591c5a-3d65-4653-abf8-e7dcd08e5935'] in dv-cinder-793885-1-iscsi is: [{'id': '35591c5a-3d65-4653-abf8-e7dcd08e5935', 'name': 'router1', 'tenant_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:03:43Z', 'updated_at': '2021-06-01T06:03:54Z', 'revision_number': 2, 'project_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'gw_port_host': None, '_interfaces': [{'id': '142ff5c4-5f00-4fd7-92f7-8d443666fad6', 'name': '', 'network_id': '6436dd36-4c6e-429d-a690-e5e157653554', 'tenant_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'mac_address': 'fa:16:3e:66:64:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '35591c5a-3d65-4653-abf8-e7dcd08e5935', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ec67bf67-c746-41d0-8af8-7ecda42bc46f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:03:53Z', 'updated_at': '2021-06-01T06:03:58Z', 'revision_number': 4, 'project_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'subnets': [{'id': 'ec67bf67-c746-41d0-8af8-7ecda42bc46f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2048e394-0c04-43ae-8dab-3a77f4304e7e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:03:59.182286 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c212a679-5e8a-4f74-9550-0256e8a833cf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:03:59.183337 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-c212a679-5e8a-4f74-9550-0256e8a833cf admin admin] Synchronizing usage tracker for tenant:6b216b27f15f4031970c8130e572d869 on resource:network {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:03:59.206357 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-c212a679-5e8a-4f74-9550-0256e8a833cf admin admin] Unset dirty status for tenant:6b216b27f15f4031970c8130e572d869 on resource:network {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:03:59.207651 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-c212a679-5e8a-4f74-9550-0256e8a833cf admin admin] 10.222.0.25 "GET /v2.0/networks/83b812fb-2cfc-46e4-baa4-745218ea3ed2 HTTP/1.1" status: 200  len: 842 time: 0.2262108
Jun 01 06:03:59.221622 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-71262008-f734-4afc-8b9d-50d8b1daa224 admin admin] Request body: {'subnet': {'gateway_ip': '172.27.2.1', 'enable_dhcp': False, 'ip_version': 4, 'name': 'public-subnet', 'cidr': '172.27.2.0/24', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:03:59.229680 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-71262008-f734-4afc-8b9d-50d8b1daa224 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:03:59.237076 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-71262008-f734-4afc-8b9d-50d8b1daa224 admin admin] Usage tracker for resource:subnet and tenant:6b216b27f15f4031970c8130e572d869 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:03:59.242188 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-71262008-f734-4afc-8b9d-50d8b1daa224 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:03:59.252328 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-71262008-f734-4afc-8b9d-50d8b1daa224 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:03:59.268275 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-71262008-f734-4afc-8b9d-50d8b1daa224 admin admin] Made reservation on behalf of 6b216b27f15f4031970c8130e572d869 for: {'subnet': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:03:59.272780 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-71262008-f734-4afc-8b9d-50d8b1daa224 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:59.957249 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.objects.ports [None req-71262008-f734-4afc-8b9d-50d8b1daa224 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=92229) get_objects /opt/stack/neutron/neutron/objects/ports.py:443}}
Jun 01 06:03:59.958011 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-71262008-f734-4afc-8b9d-50d8b1daa224 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099'] for subnet, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:03:59.966594 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:04:00.116120 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71262008-f734-4afc-8b9d-50d8b1daa224 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a59d7d11-a92c-4b4f-83cf-2095ecee2b51,revision_number=0']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:04:00.119806 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-71262008-f734-4afc-8b9d-50d8b1daa224 admin admin] Checking segment: {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:04:00.120583 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71262008-f734-4afc-8b9d-50d8b1daa224 admin admin] Network hostable DHCP agents. Network: 83b812fb-2cfc-46e4-baa4-745218ea3ed2, hostable agents: ['648832f0-f26e-4e29-ac0d-d97e4a75c6c4'], hosted agents: [] {{(pid=92229) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 06:04:00.128009 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-71262008-f734-4afc-8b9d-50d8b1daa224 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:04:00.155477 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71262008-f734-4afc-8b9d-50d8b1daa224 admin admin] Network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 is scheduled to be hosted by DHCP agent 648832f0-f26e-4e29-ac0d-d97e4a75c6c4 with binding_index 1 {{(pid=92229) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 06:04:00.172989 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-71262008-f734-4afc-8b9d-50d8b1daa224 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793885-1-iscsi, 83b812fb-2cfc-46e4-baa4-745218ea3ed2) {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:04:00.179093 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71262008-f734-4afc-8b9d-50d8b1daa224 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:04:00.180856 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-71262008-f734-4afc-8b9d-50d8b1daa224 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:00.188575 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-62c46960-0532-40c5-8ace-2c7bac870807 None None] Network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:04:00.302583 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-71262008-f734-4afc-8b9d-50d8b1daa224 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 821 time: 1.0855546
Jun 01 06:04:00.440818 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb82e612-0391-4e52-96e2-07594fa574ef None None] Network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:04:02.964554 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 57606) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:04:02.995903 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 142ff5c4-5f00-4fd7-92f7-8d443666fad6 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:04:03.100651 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port 142ff5c4-5f00-4fd7-92f7-8d443666fad6 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:04:03.113989 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 142ff5c4-5f00-4fd7-92f7-8d443666fad6 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:04:03.114561 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:03.319113 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-c92ee73c-f7d1-4688-86c6-1f11404b0dbb admin admin] 10.222.0.25 "GET /v2.0/routers/35591c5a-3d65-4653-abf8-e7dcd08e5935 HTTP/1.1" status: 200  len: 710 time: 0.3529170
Jun 01 06:04:03.373558 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:03.437405 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port 142ff5c4-5f00-4fd7-92f7-8d443666fad6, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=142ff5c4-5f00-4fd7-92f7-8d443666fad6,segment=NetworkSegment(e59d3672-44cd-4626-8b45-4e6e9f16c259),segment_id=e59d3672-44cd-4626-8b45-4e6e9f16c259)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:04:03.443281 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:03.448457 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:04:03.582182 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-592b226c-035d-456f-8186-2ff04fc8b0f7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:04:03.583197 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=142ff5c4-5f00-4fd7-92f7-8d443666fad6,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:04:03.594580 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-592b226c-035d-456f-8186-2ff04fc8b0f7 admin admin] 10.222.0.25 "GET /v2.0/networks/83b812fb-2cfc-46e4-baa4-745218ea3ed2 HTTP/1.1" status: 200  len: 886 time: 0.2662838
Jun 01 06:04:03.595040 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:04:03.601581 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-bcb61455-5901-460f-8183-3723f7cbec8b admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:04:04.328267 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-bcb61455-5901-460f-8183-3723f7cbec8b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-745539', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-748171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-728'] for router, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:04.785061 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-bcb61455-5901-460f-8183-3723f7cbec8b admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:04.819823 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 142ff5c4-5f00-4fd7-92f7-8d443666fad6 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:04:04.878655 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-bcb61455-5901-460f-8183-3723f7cbec8b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:04.908604 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 142ff5c4-5f00-4fd7-92f7-8d443666fad6 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:04:04.909005 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:05.192871 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [None req-bcb61455-5901-460f-8183-3723f7cbec8b admin admin] Allocated IP 172.27.2.29 (83b812fb-2cfc-46e4-baa4-745218ea3ed2/a59d7d11-a92c-4b4f-83cf-2095ecee2b51/3e861ae3-07c0-4dc3-87ec-97f1955044dd) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:04:05.475075 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-bcb61455-5901-460f-8183-3723f7cbec8b admin admin] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:05.525003 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-bcb61455-5901-460f-8183-3723f7cbec8b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:05.534277 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:04:05.664587 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bcb61455-5901-460f-8183-3723f7cbec8b admin admin] Network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:04:05.671017 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-bcb61455-5901-460f-8183-3723f7cbec8b admin admin] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:04:05.682837 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bcb61455-5901-460f-8183-3723f7cbec8b admin admin] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:04:05.705889 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 5 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:04:05.808515 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcb61455-5901-460f-8183-3723f7cbec8b admin admin] Pushing event updated for resources: {'Port': ['ID=3e861ae3-07c0-4dc3-87ec-97f1955044dd,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:04:05.890862 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-bcb61455-5901-460f-8183-3723f7cbec8b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.357s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:04:06.196068 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-bcb61455-5901-460f-8183-3723f7cbec8b admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:06.566328 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-bcb61455-5901-460f-8183-3723f7cbec8b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-745539', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-748171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-728'] for router, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:06.570053 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-bcb61455-5901-460f-8183-3723f7cbec8b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-745472', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-745544', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-745481', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-748189'] for router, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:06.767592 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bcb61455-5901-460f-8183-3723f7cbec8b admin admin] Router 35591c5a-3d65-4653-abf8-e7dcd08e5935 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92229) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:04:07.035665 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bcb61455-5901-460f-8183-3723f7cbec8b admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92229) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:04:07.045737 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-bcb61455-5901-460f-8183-3723f7cbec8b admin admin] Notify callbacks [] for router, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:07.046966 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-bcb61455-5901-460f-8183-3723f7cbec8b admin admin] 10.222.0.25 "PUT /v2.0/routers/35591c5a-3d65-4653-abf8-e7dcd08e5935 HTTP/1.1" status: 200  len: 889 time: 3.4513330
Jun 01 06:04:07.049047 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] Sync routers for ids ['35591c5a-3d65-4653-abf8-e7dcd08e5935'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:04:07.062572 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] Routers {'35591c5a-3d65-4653-abf8-e7dcd08e5935'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:04:07.063236 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b8807670>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:03:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['35591c5a-3d65-4653-abf8-e7dcd08e5935'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:04:07.327641 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] Set router 35591c5a-3d65-4653-abf8-e7dcd08e5935 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:04:07.807117 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b8807670>, [{'id': '35591c5a-3d65-4653-abf8-e7dcd08e5935', 'name': 'router1', 'tenant_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.29'}], 'enable_snat': True}, 'gw_port_id': '3e861ae3-07c0-4dc3-87ec-97f1955044dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:03:43Z', 'updated_at': '2021-06-01T06:04:05Z', 'revision_number': 4, 'project_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'gw_port': {'id': '3e861ae3-07c0-4dc3-87ec-97f1955044dd', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:68:0e:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '35591c5a-3d65-4653-abf8-e7dcd08e5935', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:04:04Z', 'updated_at': '2021-06-01T06:04:05Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '142ff5c4-5f00-4fd7-92f7-8d443666fad6', 'name': '', 'network_id': '6436dd36-4c6e-429d-a690-e5e157653554', 'tenant_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'mac_address': 'fa:16:3e:66:64:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '35591c5a-3d65-4653-abf8-e7dcd08e5935', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ec67bf67-c746-41d0-8af8-7ecda42bc46f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:03:53Z', 'updated_at': '2021-06-01T06:04:03Z', 'revision_number': 5, 'project_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'subnets': [{'id': 'ec67bf67-c746-41d0-8af8-7ecda42bc46f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2048e394-0c04-43ae-8dab-3a77f4304e7e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:04:07.813320 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] Checking router: 35591c5a-3d65-4653-abf8-e7dcd08e5935 for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:04:07.813744 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] Updating router 35591c5a-3d65-4653-abf8-e7dcd08e5935 port 3e861ae3-07c0-4dc3-87ec-97f1955044dd binding host dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 06:04:07.873880 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:08.306076 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-a3b90326-10b9-4219-94f9-6c2de64b2f09 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:08.404428 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] Notify callbacks [] for port, precommit_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:08.420829 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] Transition to ACTIVE for port object 3e861ae3-07c0-4dc3-87ec-97f1955044dd will not be triggered until provisioned by entity L2. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:04:08.428754 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:08.434818 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:04:08.551576 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] Attempting to bind port 3e861ae3-07c0-4dc3-87ec-97f1955044dd on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:04:08.552210 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] Attempting to bind port 3e861ae3-07c0-4dc3-87ec-97f1955044dd by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:04:08.552816 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] Attempting to bind port 3e861ae3-07c0-4dc3-87ec-97f1955044dd on network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:04:08.581573 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 3, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:04:08.582197 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] Checking segment: {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92231) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:04:08.582893 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:08.583543 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] Bound using segment: {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:04:08.584414 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] Bound port: 3e861ae3-07c0-4dc3-87ec-97f1955044dd, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:04:08.585052 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:08.628614 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa47bf44-489e-4262-844d-3dfa4e4fd3aa None None] Pushing event updated for resources: {'Port': ['ID=3e861ae3-07c0-4dc3-87ec-97f1955044dd,revision_number=2']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:04:08.632471 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-aa47bf44-489e-4262-844d-3dfa4e4fd3aa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.197s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:04:08.723904 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] For port 3e861ae3-07c0-4dc3-87ec-97f1955044dd, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92231) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:04:08.730705 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] For port 3e861ae3-07c0-4dc3-87ec-97f1955044dd, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=3e861ae3-07c0-4dc3-87ec-97f1955044dd,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92231) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:04:08.737405 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:08.747020 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:04:08.821564 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] Routers {'35591c5a-3d65-4653-abf8-e7dcd08e5935'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:04:08.822183 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b8807670>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:03:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['35591c5a-3d65-4653-abf8-e7dcd08e5935'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:04:08.983878 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa47bf44-489e-4262-844d-3dfa4e4fd3aa None None] Pushing event updated for resources: {'Port': ['ID=3e861ae3-07c0-4dc3-87ec-97f1955044dd,revision_number=3']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:04:09.006346 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-aa47bf44-489e-4262-844d-3dfa4e4fd3aa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.258s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:04:09.050081 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] Set router 35591c5a-3d65-4653-abf8-e7dcd08e5935 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:04:09.430229 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b8807670>, [{'id': '35591c5a-3d65-4653-abf8-e7dcd08e5935', 'name': 'router1', 'tenant_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.29'}], 'enable_snat': True}, 'gw_port_id': '3e861ae3-07c0-4dc3-87ec-97f1955044dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:03:43Z', 'updated_at': '2021-06-01T06:04:05Z', 'revision_number': 4, 'project_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'gw_port': {'id': '3e861ae3-07c0-4dc3-87ec-97f1955044dd', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:68:0e:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '35591c5a-3d65-4653-abf8-e7dcd08e5935', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:04:04Z', 'updated_at': '2021-06-01T06:04:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '142ff5c4-5f00-4fd7-92f7-8d443666fad6', 'name': '', 'network_id': '6436dd36-4c6e-429d-a690-e5e157653554', 'tenant_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'mac_address': 'fa:16:3e:66:64:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '35591c5a-3d65-4653-abf8-e7dcd08e5935', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ec67bf67-c746-41d0-8af8-7ecda42bc46f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:03:53Z', 'updated_at': '2021-06-01T06:04:03Z', 'revision_number': 5, 'project_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'subnets': [{'id': 'ec67bf67-c746-41d0-8af8-7ecda42bc46f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2048e394-0c04-43ae-8dab-3a77f4304e7e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:04:09.436221 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7229d35-53bc-4345-b3a7-f12ed52b07e6 None None] The sync data for ids ['35591c5a-3d65-4653-abf8-e7dcd08e5935'] in dv-cinder-793885-1-iscsi is: [{'id': '35591c5a-3d65-4653-abf8-e7dcd08e5935', 'name': 'router1', 'tenant_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.29'}], 'enable_snat': True}, 'gw_port_id': '3e861ae3-07c0-4dc3-87ec-97f1955044dd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:03:43Z', 'updated_at': '2021-06-01T06:04:05Z', 'revision_number': 4, 'project_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'gw_port': {'id': '3e861ae3-07c0-4dc3-87ec-97f1955044dd', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:68:0e:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '35591c5a-3d65-4653-abf8-e7dcd08e5935', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:04:04Z', 'updated_at': '2021-06-01T06:04:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '142ff5c4-5f00-4fd7-92f7-8d443666fad6', 'name': '', 'network_id': '6436dd36-4c6e-429d-a690-e5e157653554', 'tenant_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'mac_address': 'fa:16:3e:66:64:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '35591c5a-3d65-4653-abf8-e7dcd08e5935', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ec67bf67-c746-41d0-8af8-7ecda42bc46f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:03:53Z', 'updated_at': '2021-06-01T06:04:03Z', 'revision_number': 5, 'project_id': 'db8a8dba8ad74c49abcee38bbaec0734', 'subnets': [{'id': 'ec67bf67-c746-41d0-8af8-7ecda42bc46f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2048e394-0c04-43ae-8dab-3a77f4304e7e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:04:10.140617 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 57616) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:04:10.294700 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-8d6646f0-ef0e-49ed-a473-09b31dc3089c admin admin] 10.222.0.25 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200  len: 410 time: 0.1524785
Jun 01 06:04:10.875600 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 3e861ae3-07c0-4dc3-87ec-97f1955044dd up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:04:10.975309 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port 3e861ae3-07c0-4dc3-87ec-97f1955044dd completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:04:10.985019 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 3e861ae3-07c0-4dc3-87ec-97f1955044dd triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:04:10.985634 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:11.256403 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:11.269546 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:11.288137 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port 3e861ae3-07c0-4dc3-87ec-97f1955044dd, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=3e861ae3-07c0-4dc3-87ec-97f1955044dd,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:04:11.297047 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:11.302670 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-aa47bf44-489e-4262-844d-3dfa4e4fd3aa None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:04:11.400233 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=3e861ae3-07c0-4dc3-87ec-97f1955044dd,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:04:11.404177 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:04:12.328863 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-c36ef120-0bea-4d58-ba61-7a97b53a687d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:12.841860 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 3e861ae3-07c0-4dc3-87ec-97f1955044dd up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:04:13.006935 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 3e861ae3-07c0-4dc3-87ec-97f1955044dd triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:04:13.007319 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:13.199628 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:15.305197 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:38.403220 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b4eaccdd-bfa7-4e54-8f5e-3bb95287de93 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:41.241623 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:42.327388 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-62ced029-6801-4707-bbb3-3ed7776570e9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:42.717469 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 5 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:04:43.205774 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:04:45.332407 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:05:08.296248 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-c71d7079-326e-47ab-b735-aac18fef6687 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:05:11.178751 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:05:12.324014 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-5f5f793b-10ee-43ba-b1db-347235bcb00f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:05:13.206055 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:05:15.284150 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:05:19.708290 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 5 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:05:38.300188 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-3d336bbf-6155-4936-8552-adc7bc4ec84c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:05:41.166748 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:05:42.324100 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-51ede713-2253-44b3-849c-75c9f8046c8d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:05:43.201967 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:05:45.288688 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:05:56.709543 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 5 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:06:06.139083 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 58188) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:06:06.234667 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.pecan_wsgi.hooks.translation [None req-ba8e5a3a-fef6-41ca-ac08-b8da5f794f46 admin admin] GET failed (client error): The resource could not be found.
Jun 01 06:06:06.236975 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-ba8e5a3a-fef6-41ca-ac08-b8da5f794f46 admin admin] 10.222.0.25 "GET /v2.0/networks/private HTTP/1.1" status: 404  len: 315 time: 0.0964236
Jun 01 06:06:06.468476 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-53a27c42-e895-4fa0-a436-e22990a6f540 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:06:06.470160 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-53a27c42-e895-4fa0-a436-e22990a6f540 admin admin] 10.222.0.25 "GET /v2.0/networks?name=private HTTP/1.1" status: 200  len: 872 time: 0.2210531
Jun 01 06:06:08.295345 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-f11b352a-6059-4387-8351-04f5d01d2048 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:06:08.789976 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 58198) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:06:08.961933 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af71efc9-0748-4da6-b058-474827fd4bfc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:06:08.962798 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-af71efc9-0748-4da6-b058-474827fd4bfc admin admin] Synchronizing usage tracker for tenant:6b216b27f15f4031970c8130e572d869 on resource:subnet {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:06:08.988594 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-af71efc9-0748-4da6-b058-474827fd4bfc admin admin] Unset dirty status for tenant:6b216b27f15f4031970c8130e572d869 on resource:subnet {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:06:08.989911 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-af71efc9-0748-4da6-b058-474827fd4bfc admin admin] 10.222.0.25 "GET /v2.0/subnets/ec67bf67-c746-41d0-8af8-7ecda42bc46f HTTP/1.1" status: 200  len: 849 time: 0.1988573
Jun 01 06:06:09.000388 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-7cf3076b-730e-4b3d-975a-fb5155f3ebf6 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:06:09.131871 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7cf3076b-730e-4b3d-975a-fb5155f3ebf6 admin admin] Notify callbacks [] for subnet, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:06:09.350471 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7cf3076b-730e-4b3d-975a-fb5155f3ebf6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8788496929437'] for subnet, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:06:09.355728 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-71262008-f734-4afc-8b9d-50d8b1daa224 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:06:09.403994 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7cf3076b-730e-4b3d-975a-fb5155f3ebf6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:06:09.404582 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7cf3076b-730e-4b3d-975a-fb5155f3ebf6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:06:09.406433 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-7cf3076b-730e-4b3d-975a-fb5155f3ebf6 admin admin] 10.222.0.25 "PUT /v2.0/subnets/ec67bf67-c746-41d0-8af8-7ecda42bc46f HTTP/1.1" status: 200  len: 868 time: 0.4096303
Jun 01 06:06:09.411737 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a4dab2d9-98ad-4633-bcc5-3069939e4563 None None] Network 6436dd36-4c6e-429d-a690-e5e157653554 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:06:09.436138 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cf3076b-730e-4b3d-975a-fb5155f3ebf6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ec67bf67-c746-41d0-8af8-7ecda42bc46f,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:06:09.445495 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf3076b-730e-4b3d-975a-fb5155f3ebf6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:06:09.446441 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf3076b-730e-4b3d-975a-fb5155f3ebf6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:06:09.446441 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf3076b-730e-4b3d-975a-fb5155f3ebf6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:06:09.446680 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf3076b-730e-4b3d-975a-fb5155f3ebf6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:06:09.446844 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf3076b-730e-4b3d-975a-fb5155f3ebf6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:06:09.447236 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf3076b-730e-4b3d-975a-fb5155f3ebf6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:06:09.447468 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf3076b-730e-4b3d-975a-fb5155f3ebf6 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:06:09.447839 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf3076b-730e-4b3d-975a-fb5155f3ebf6 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:06:09.448186 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf3076b-730e-4b3d-975a-fb5155f3ebf6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:06:09.448580 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf3076b-730e-4b3d-975a-fb5155f3ebf6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:06:09.448990 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf3076b-730e-4b3d-975a-fb5155f3ebf6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:06:09.449239 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf3076b-730e-4b3d-975a-fb5155f3ebf6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:06:09.453254 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-7cf3076b-730e-4b3d-975a-fb5155f3ebf6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:06:10.036968 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-b2a18dfa-52df-4abc-bdde-d95d21190b83 None None] Provisioning complete for port 418071d4-b320-4335-a4a6-22ed1a75db92 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:06:10.037450 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b2a18dfa-52df-4abc-bdde-d95d21190b83 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:06:10.175760 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-b2a18dfa-52df-4abc-bdde-d95d21190b83 None None] Provisioning complete for port 142ff5c4-5f00-4fd7-92f7-8d443666fad6 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:06:10.176097 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b2a18dfa-52df-4abc-bdde-d95d21190b83 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:06:11.162441 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:06:11.688569 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 58208) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:06:11.887029 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6f2a82bd-c431-4c3d-8246-5440ae8f9ed1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:06:11.887510 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6f2a82bd-c431-4c3d-8246-5440ae8f9ed1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:06:11.889099 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-6f2a82bd-c431-4c3d-8246-5440ae8f9ed1 admin admin] 10.222.0.25 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.1995201
Jun 01 06:06:12.317271 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fd9efdaf-5fc8-4a0c-ba39-f770a1e96aa2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:06:13.208713 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:06:14.159066 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 58218) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:06:14.351472 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1a56fc65-ae62-4608-b911-efd1d71a0f5a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:06:14.351973 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1a56fc65-ae62-4608-b911-efd1d71a0f5a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:06:14.353540 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-1a56fc65-ae62-4608-b911-efd1d71a0f5a admin admin] 10.222.0.25 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.1935263
Jun 01 06:06:15.295181 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:06:16.619028 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 58228) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:06:16.837061 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-654c868b-5844-4042-ae2d-ae87b68b28ce admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:06:16.838384 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-654c868b-5844-4042-ae2d-ae87b68b28ce admin admin] 10.222.0.25 "GET /v2.0/networks/6436dd36-4c6e-429d-a690-e5e157653554 HTTP/1.1" status: 200  len: 869 time: 0.2180157
Jun 01 06:06:19.164934 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 58238) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:06:19.347245 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1acbaf89-1f29-4e01-a01f-0674b31e0cee admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:06:19.348572 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-1acbaf89-1f29-4e01-a01f-0674b31e0cee admin admin] 10.222.0.25 "GET /v2.0/networks/83b812fb-2cfc-46e4-baa4-745218ea3ed2 HTTP/1.1" status: 200  len: 886 time: 0.1826906
Jun 01 06:06:21.721989 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 58248) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:06:21.844461 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9c3767ca-e221-4b36-8b66-b059427b6497 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:06:21.844919 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9c3767ca-e221-4b36-8b66-b059427b6497 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:06:21.846445 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-9c3767ca-e221-4b36-8b66-b059427b6497 admin admin] 10.222.0.25 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1234529
Jun 01 06:06:24.113033 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 58258) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:06:24.228731 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c80a37ca-fab9-4840-ae98-755fe642f9ae admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:06:24.229189 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c80a37ca-fab9-4840-ae98-755fe642f9ae admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:06:24.230742 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-c80a37ca-fab9-4840-ae98-755fe642f9ae admin admin] 10.222.0.25 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1167667
Jun 01 06:06:26.430385 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 58268) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:06:26.543588 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-797b0fe4-74dc-40f9-bfde-0ce6d71a532e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:06:26.545892 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-797b0fe4-74dc-40f9-bfde-0ce6d71a532e admin admin] 10.222.0.25 "GET /v2.0/subnets/a59d7d11-a92c-4b4f-83cf-2095ecee2b51 HTTP/1.1" status: 200  len: 816 time: 0.1143839
Jun 01 06:06:28.769102 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 58278) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:06:28.892310 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00d35ae9-1192-4f65-8108-d30cb35edb0b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:06:28.893648 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-00d35ae9-1192-4f65-8108-d30cb35edb0b admin admin] 10.222.0.25 "GET /v2.0/subnets/ec67bf67-c746-41d0-8af8-7ecda42bc46f HTTP/1.1" status: 200  len: 868 time: 0.1235123
Jun 01 06:06:33.710866 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 5 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:06:38.301313 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-ea31c183-3d9c-4aef-957c-b0f12db844dd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:06:41.156292 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:06:42.322947 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-492863b7-016a-49bf-893e-72099e81b84c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:06:43.205040 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:06:45.297777 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:06:53.923182 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 58322) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:06:53.972383 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [None req-d5b7a016-7566-4327-b290-842e1bac0672 admin admin] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=92230) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 06:06:53.973507 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-d5b7a016-7566-4327-b290-842e1bac0672 admin admin] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0494559
Jun 01 06:06:56.228948 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 58332) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:06:56.298805 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.pecan_wsgi.hooks.translation [None req-8db5047a-65d6-4c38-92d1-061f17230685 admin admin] GET failed (client error): The resource could not be found.
Jun 01 06:06:56.300134 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-8db5047a-65d6-4c38-92d1-061f17230685 admin admin] 10.222.0.25 "GET /v2.0/networks/public HTTP/1.1" status: 404  len: 314 time: 0.0702283
Jun 01 06:06:56.437023 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b0961d73-0bd6-4adf-9cea-1127873f73f5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:06:56.438387 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-b0961d73-0bd6-4adf-9cea-1127873f73f5 admin admin] 10.222.0.25 "GET /v2.0/networks?name=public HTTP/1.1" status: 200  len: 889 time: 0.1339231
Jun 01 06:06:58.623351 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 58342) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:06:58.674820 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-9af64a80-5ef9-4b22-bf35-ddb23ecc174f admin admin] Request body: {'network': {'name': 'shared', 'admin_state_up': True, 'shared': True}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:06:58.679378 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-9af64a80-5ef9-4b22-bf35-ddb23ecc174f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:06:58.689074 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-9af64a80-5ef9-4b22-bf35-ddb23ecc174f admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:06:58.699614 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9af64a80-5ef9-4b22-bf35-ddb23ecc174f admin admin] Made reservation on behalf of 6b216b27f15f4031970c8130e572d869 for: {'network': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:06:58.701875 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-9af64a80-5ef9-4b22-bf35-ddb23ecc174f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-8110114'] for network, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:06:58.790093 dv-cinder-793885-1-iscsi neutron-server[92229]: WARNING neutron.services.revisions.revision_plugin [None req-9af64a80-5ef9-4b22-bf35-ddb23ecc174f admin admin] Could not find related network for resource <neutron.db.rbac_db_models.NetworkRBAC[object at 7fe3b3112b20] {project_id='6b216b27f15f4031970c8130e572d869', id='50a1234c-94f6-40d8-9944-a573990fe06c', target_tenant='*', action='access_as_shared', object_id='a6d7f63e-e70d-44f5-881d-b8b75ee09c7f'}> to bump revision.
Jun 01 06:06:58.802787 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9af64a80-5ef9-4b22-bf35-ddb23ecc174f admin admin] vlan segment allocate from pool success with {'vlan_id': 235, 'physical_network': 'physnet1'}  {{(pid=92229) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 06:06:58.813447 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-9af64a80-5ef9-4b22-bf35-ddb23ecc174f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:06:58.813796 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.db.segments_db [None req-9af64a80-5ef9-4b22-bf35-ddb23ecc174f admin admin] Added segment 2163afda-8422-40f1-8678-56aeadbe45b7 of type vlan for network a6d7f63e-e70d-44f5-881d-b8b75ee09c7f
Jun 01 06:06:58.841520 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-9af64a80-5ef9-4b22-bf35-ddb23ecc174f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8788496565589'] for network, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:06:58.871445 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-9af64a80-5ef9-4b22-bf35-ddb23ecc174f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104'] for network, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:06:58.872776 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9af64a80-5ef9-4b22-bf35-ddb23ecc174f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:06:58.873351 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-9af64a80-5ef9-4b22-bf35-ddb23ecc174f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:06:58.878137 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:06:58.976291 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-9af64a80-5ef9-4b22-bf35-ddb23ecc174f admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 0.3518136
Jun 01 06:06:58.979312 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9af64a80-5ef9-4b22-bf35-ddb23ecc174f admin admin] Pushing event updated for resources: {'Network': ['ID=a6d7f63e-e70d-44f5-881d-b8b75ee09c7f,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:06:58.989476 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-9af64a80-5ef9-4b22-bf35-ddb23ecc174f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:06:59.003544 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Network a6d7f63e-e70d-44f5-881d-b8b75ee09c7f details requested by agent ovs-agent-dv-cinder-793885-1-iscsi with host dv-cinder-793885-1-iscsi {{(pid=92231) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 06:07:01.144781 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 58352) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:07:01.213487 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.pecan_wsgi.hooks.translation [None req-fbe9289d-0124-4f37-aefe-75489ac65219 admin admin] GET failed (client error): The resource could not be found.
Jun 01 06:07:01.214005 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-fbe9289d-0124-4f37-aefe-75489ac65219 admin admin] Synchronizing usage tracker for tenant:6b216b27f15f4031970c8130e572d869 on resource:network {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:07:01.229991 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-fbe9289d-0124-4f37-aefe-75489ac65219 admin admin] Unset dirty status for tenant:6b216b27f15f4031970c8130e572d869 on resource:network {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:07:01.231217 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-fbe9289d-0124-4f37-aefe-75489ac65219 admin admin] 10.222.0.25 "GET /v2.0/networks/shared HTTP/1.1" status: 404  len: 314 time: 0.0854852
Jun 01 06:07:01.385781 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73aec3a2-41b2-405e-9ff2-460b73f6f4b6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:07:01.387272 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-73aec3a2-41b2-405e-9ff2-460b73f6f4b6 admin admin] 10.222.0.25 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200  len: 826 time: 0.1521986
Jun 01 06:07:01.399796 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-65875ccf-c3e3-45c4-a87d-3387f0af1863 admin admin] Request body: {'subnet': {'description': 'shared-subnet', 'network_id': 'a6d7f63e-e70d-44f5-881d-b8b75ee09c7f', 'cidr': '192.168.233.0/24', 'name': 'shared-subnet', 'ip_version': 4}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:07:01.404446 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-65875ccf-c3e3-45c4-a87d-3387f0af1863 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:07:01.414853 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-65875ccf-c3e3-45c4-a87d-3387f0af1863 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:07:01.424488 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-65875ccf-c3e3-45c4-a87d-3387f0af1863 admin admin] Made reservation on behalf of 6b216b27f15f4031970c8130e572d869 for: {'subnet': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:07:01.426883 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-65875ccf-c3e3-45c4-a87d-3387f0af1863 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:07:01.807293 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-65875ccf-c3e3-45c4-a87d-3387f0af1863 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099'] for subnet, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:07:01.811986 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:07:01.880525 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65875ccf-c3e3-45c4-a87d-3387f0af1863 admin admin] Pushing event updated for resources: {'Subnet': ['ID=207ba625-cb20-4380-b8f8-452b3a0a4864,revision_number=0']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:07:01.884846 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-65875ccf-c3e3-45c4-a87d-3387f0af1863 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:07:01.890450 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65875ccf-c3e3-45c4-a87d-3387f0af1863 admin admin] Checking segment: {'id': '2163afda-8422-40f1-8678-56aeadbe45b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 235, 'network_id': 'a6d7f63e-e70d-44f5-881d-b8b75ee09c7f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:07:01.890795 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-65875ccf-c3e3-45c4-a87d-3387f0af1863 admin admin] Network hostable DHCP agents. Network: a6d7f63e-e70d-44f5-881d-b8b75ee09c7f, hostable agents: ['648832f0-f26e-4e29-ac0d-d97e4a75c6c4'], hosted agents: [] {{(pid=92229) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 06:07:01.906982 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-65875ccf-c3e3-45c4-a87d-3387f0af1863 admin admin] Network a6d7f63e-e70d-44f5-881d-b8b75ee09c7f is scheduled to be hosted by DHCP agent 648832f0-f26e-4e29-ac0d-d97e4a75c6c4 with binding_index 1 {{(pid=92229) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 06:07:01.916084 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-65875ccf-c3e3-45c4-a87d-3387f0af1863 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793885-1-iscsi, a6d7f63e-e70d-44f5-881d-b8b75ee09c7f) {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:07:01.920298 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-65875ccf-c3e3-45c4-a87d-3387f0af1863 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:07:01.920883 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-65875ccf-c3e3-45c4-a87d-3387f0af1863 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:07:01.925659 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-98845a0b-4990-4d06-be47-f90fbaffd0e9 None None] Network a6d7f63e-e70d-44f5-881d-b8b75ee09c7f requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:07:01.946447 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-65875ccf-c3e3-45c4-a87d-3387f0af1863 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.5510461
Jun 01 06:07:02.169899 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp5012ce77-b332-5f05-8982-a48a8fc8d50e-a6d7f63e-e70d-44f5-881d-b8b75ee09c7f', 'network_id': 'a6d7f63e-e70d-44f5-881d-b8b75ee09c7f', 'tenant_id': '6b216b27f15f4031970c8130e572d869', 'fixed_ips': [{'subnet_id': '207ba625-cb20-4380-b8f8-452b3a0a4864'}]}} from dv-cinder-793885-1-iscsi. {{(pid=92231) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 06:07:02.171097 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:07:02.337886 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.db_base_plugin_common [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Allocated IP 192.168.233.2 (a6d7f63e-e70d-44f5-881d-b8b75ee09c7f/207ba625-cb20-4380-b8f8-452b3a0a4864/e9a3d4f9-e3ff-4ecc-a3ea-83113a8ad456) {{(pid=92231) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:07:02.556688 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Notify callbacks [] for port, precommit_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:07:02.567695 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Transition to ACTIVE for port object e9a3d4f9-e3ff-4ecc-a3ea-83113a8ad456 will not be triggered until provisioned by entity L2. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:07:02.587529 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Transition to ACTIVE for port object e9a3d4f9-e3ff-4ecc-a3ea-83113a8ad456 will not be triggered until provisioned by entity DHCP. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:07:02.593905 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:07:02.598706 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-aa47bf44-489e-4262-844d-3dfa4e4fd3aa None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:07:02.668032 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Network a6d7f63e-e70d-44f5-881d-b8b75ee09c7f is already hosted by enough agents. {{(pid=92231) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:07:02.670650 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.scheduler.base_scheduler [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Resources bound (agent type, host, resource id):  {{(pid=92231) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:07:02.675000 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Received port after_create {{(pid=92231) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:07:02.677156 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Pushing event updated for resources: {'Port': ['ID=e9a3d4f9-e3ff-4ecc-a3ea-83113a8ad456,revision_number=1']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:07:02.714553 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:07:02.714887 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:07:02.715215 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:07:02.715540 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:07:02.715887 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:07:02.716203 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:07:02.716546 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:07:02.716812 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:07:02.717162 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:07:02.717476 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:07:02.717795 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:07:02.718105 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:07:02.727162 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:07:02.788582 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Attempting to bind port e9a3d4f9-e3ff-4ecc-a3ea-83113a8ad456 on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:07:02.788945 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Attempting to bind port e9a3d4f9-e3ff-4ecc-a3ea-83113a8ad456 by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': '2163afda-8422-40f1-8678-56aeadbe45b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 235, 'network_id': 'a6d7f63e-e70d-44f5-881d-b8b75ee09c7f'}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:07:02.789292 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Attempting to bind port e9a3d4f9-e3ff-4ecc-a3ea-83113a8ad456 on network a6d7f63e-e70d-44f5-881d-b8b75ee09c7f {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:07:02.794974 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 6, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:07:02.795333 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Checking segment: {'id': '2163afda-8422-40f1-8678-56aeadbe45b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 235, 'network_id': 'a6d7f63e-e70d-44f5-881d-b8b75ee09c7f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92231) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:07:02.795717 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:07:02.796127 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Bound using segment: {'id': '2163afda-8422-40f1-8678-56aeadbe45b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 235, 'network_id': 'a6d7f63e-e70d-44f5-881d-b8b75ee09c7f'} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:07:02.796575 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Bound port: e9a3d4f9-e3ff-4ecc-a3ea-83113a8ad456, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2163afda-8422-40f1-8678-56aeadbe45b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 235, 'network_id': 'a6d7f63e-e70d-44f5-881d-b8b75ee09c7f'}}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:07:02.796936 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:07:02.886704 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] For port e9a3d4f9-e3ff-4ecc-a3ea-83113a8ad456, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92231) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:07:02.890253 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] For port e9a3d4f9-e3ff-4ecc-a3ea-83113a8ad456, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=e9a3d4f9-e3ff-4ecc-a3ea-83113a8ad456,segment=NetworkSegment(2163afda-8422-40f1-8678-56aeadbe45b7),segment_id=2163afda-8422-40f1-8678-56aeadbe45b7)] {{(pid=92231) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:07:02.895408 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:07:02.900454 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:07:02.983135 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Pushing event updated for resources: {'Port': ['ID=e9a3d4f9-e3ff-4ecc-a3ea-83113a8ad456,revision_number=2']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:07:02.986016 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:07:03.809654 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e1a3e9d8-76ec-4c99-b013-c891d5b7dd2c None None] Network a6d7f63e-e70d-44f5-881d-b8b75ee09c7f requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:07:03.915928 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-41cc1c31-8b50-447c-9cec-08a05bfa04d8 None None] Provisioning for port e9a3d4f9-e3ff-4ecc-a3ea-83113a8ad456 completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:07:04.977931 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device e9a3d4f9-e3ff-4ecc-a3ea-83113a8ad456 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:07:05.052523 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port e9a3d4f9-e3ff-4ecc-a3ea-83113a8ad456 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:07:05.058811 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port e9a3d4f9-e3ff-4ecc-a3ea-83113a8ad456 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:07:05.059177 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:07:05.179939 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:07:05.212563 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port e9a3d4f9-e3ff-4ecc-a3ea-83113a8ad456, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=e9a3d4f9-e3ff-4ecc-a3ea-83113a8ad456,segment=NetworkSegment(2163afda-8422-40f1-8678-56aeadbe45b7),segment_id=2163afda-8422-40f1-8678-56aeadbe45b7)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:07:05.216431 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:07:05.219701 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:07:05.284558 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=e9a3d4f9-e3ff-4ecc-a3ea-83113a8ad456,revision_number=3']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:07:05.287557 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:07:06.963698 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device e9a3d4f9-e3ff-4ecc-a3ea-83113a8ad456 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:07:07.037089 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port e9a3d4f9-e3ff-4ecc-a3ea-83113a8ad456 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:07:07.037451 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:07:08.294832 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-1c7ddae8-74b1-483a-9606-364f4dd86157 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:07:10.711552 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 5 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:07:11.164690 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:07:12.327013 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-adc04e70-2a20-4616-88d7-0d857a1270db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:07:13.210843 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:07:15.320613 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:07:38.299148 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-651e169d-2daf-4f6d-b08c-5bfe735504df None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:07:41.165891 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:07:42.335729 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-db561feb-a9ed-4f80-beaf-a54c5c625667 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:07:43.216397 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:07:45.305616 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:07:47.711236 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 5 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:08:08.304562 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-3f33a3f2-5863-4cc3-b929-bb453ffcce15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:08:11.159858 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:08:12.330714 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-776268c9-8ff2-4201-a087-b5c85d74b469 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:08:12.797786 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 58402) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:08:12.804291 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [None req-a48b6d95-8fea-4723-b74c-f9b581f3d67b tempest-verify_tempest_config-1078686662 tempest-verify_tempest_config-1078686662-project] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=92229) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 06:08:12.805240 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-a48b6d95-8fea-4723-b74c-f9b581f3d67b tempest-verify_tempest_config-1078686662 tempest-verify_tempest_config-1078686662-project] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13635 time: 0.0065200
Jun 01 06:08:13.112549 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 58420) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:08:13.216331 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:08:13.233887 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:08:13.249237 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:08:13.253028 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Usage tracker for resource:security_group_rule and tenant:f0441d3a57694b06aa9ffee6f855d5db is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:08:13.255842 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:08:13.261962 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:08:13.354004 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:08:13.358253 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:08:13.366764 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:08:13.410204 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Synchronizing usage tracker for tenant:6b216b27f15f4031970c8130e572d869 on resource:security_group {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:08:13.414117 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6a0bd12b-77b5-42dc-9e85-7487cc90a02d,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:08:13.422582 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:08:13.422933 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:08:13.423261 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:08:13.423578 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:08:13.423928 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:08:13.424260 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:08:13.424570 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:08:13.424878 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:08:13.425199 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:08:13.425507 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:08:13.425813 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:08:13.426116 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:08:13.432376 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:08:13.444222 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Unset dirty status for tenant:6b216b27f15f4031970c8130e572d869 on resource:security_group {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:08:13.445461 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=f0441d3a57694b06aa9ffee6f855d5db&name=default HTTP/1.1" status: 200  len: 2975 time: 0.3319709
Jun 01 06:08:13.448243 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 58426) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:08:13.508983 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-79186c12-b3aa-423c-b2df-4c116dacae78 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:08:13.535341 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-79186c12-b3aa-423c-b2df-4c116dacae78 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:08:13.629859 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-79186c12-b3aa-423c-b2df-4c116dacae78 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:08:13.634707 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-3b8b8303-a0d6-444f-9486-821cba3016d7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:08:13.645604 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79186c12-b3aa-423c-b2df-4c116dacae78 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6a0bd12b-77b5-42dc-9e85-7487cc90a02d,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:08:13.647946 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-79186c12-b3aa-423c-b2df-4c116dacae78 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:08:13.653910 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-79186c12-b3aa-423c-b2df-4c116dacae78 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:08:13.656022 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-79186c12-b3aa-423c-b2df-4c116dacae78 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/6a0bd12b-77b5-42dc-9e85-7487cc90a02d HTTP/1.1" status: 204  len: 168 time: 0.2058797
Jun 01 06:08:15.301801 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:08:24.709688 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 5 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:08:38.308702 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-93abd117-89f8-4c8e-8f72-aa2f88344837 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:08:41.162386 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:08:42.334742 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-ad57af23-195f-4242-bcc7-c91253d3829e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:08:43.216626 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:08:45.309773 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:09:01.709753 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 5 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:09:08.315703 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-3c665e29-4e4f-402c-b380-123e05fe2b10 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:09:11.165796 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:09:12.330649 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-48cc2d6b-15ff-4959-90e4-c09777ad50b8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:09:13.223236 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:09:15.306461 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:09:38.308685 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-759951b9-3b6c-4215-8955-5e5ab01de9fb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:09:38.708458 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 5 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:09:41.170179 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:09:42.337914 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-efc918a5-063d-43cd-b8ec-607e1ba926ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:09:43.224310 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:09:45.223482 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318'] for agent, after_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:09:45.314970 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:09:49.058835 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 58478) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:09:49.242736 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-5ba39007-e1f6-45e6-a679-55ec92d65ff8 admin admin] 10.222.0.25 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.1820776
Jun 01 06:09:51.511084 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 58488) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:09:51.589160 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-9b5eefd4-8ad2-4259-99bd-478524d53951 admin admin] 10.222.0.25 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.0754967
Jun 01 06:10:08.313473 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fcaa3441-088c-42d2-807b-13964aa1ea2d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:10:11.175473 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:10:12.338622 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-96818511-be16-4c51-808b-e8283ed20cd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:10:13.227194 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:10:15.183206 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:10:15.316498 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:10:15.708316 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:10:38.317129 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d49f8739-03ed-4a9e-918e-883cf4436319 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:10:41.187441 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:10:42.336538 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-066a296d-c3c6-4a6e-a4cc-365ae57ba30b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:10:43.231949 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:10:45.227264 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:10:45.345834 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:10:52.711703 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:11:08.330988 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-eb3fa233-ca2e-414e-8aa9-1de83d018f1a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:11.184186 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:12.331021 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b993eb1a-e5b0-4814-b0c3-8bbf9f7a79f8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:13.250373 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:15.237867 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:15.340004 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:18.991006 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 58686) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:19.542991 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-173264809-network', 'tenant_id': 'b02068c8f29e4f5e9b3c965d023f7e29'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:19.548584 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:19.553307 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Usage tracker for resource:network and tenant:b02068c8f29e4f5e9b3c965d023f7e29 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:19.557235 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:19.564776 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:19.581733 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Made reservation on behalf of b02068c8f29e4f5e9b3c965d023f7e29 for: {'network': 1} {{(pid=92230) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:11:19.584552 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-8110114'] for network, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:19.597965 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:19.616742 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:19.621024 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Usage tracker for resource:security_group_rule and tenant:b02068c8f29e4f5e9b3c965d023f7e29 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:19.624297 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:19.630891 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 58706) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:19.637458 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:19.756491 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:19.761583 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:19.766946 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:19.803140 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=160af0eb-1010-4f15-828e-742d9c107c26,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:19.820070 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] vlan segment allocate from pool success with {'vlan_id': 206, 'physical_network': 'physnet1'}  {{(pid=92230) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 06:11:19.823481 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:19.823882 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:19.824217 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:19.824543 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:19.824865 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:19.825263 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:19.826231 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:19.826566 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:19.826896 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:19.827211 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:19.828110 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:19.828110 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Tracked resource versions report:
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]: pushed versions:
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]: {   'AddressGroup': {'1.2'},
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:     'ConntrackHelper': {'1.0'},
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:     'Log': {'1.0'},
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:     'Network': {'1.1'},
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:     'Port': {'1.7'},
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:     'PortForwarding': {'1.2'},
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:     'QosPolicy': {'1.8'},
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:     'SecurityGroup': {'1.4'},
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:     'SecurityGroupRule': {'1.2'},
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:     'SubPort': {'1.0'},
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:     'Subnet': {'1.1'},
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:     'Trunk': {'1.1'}}
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]: consumer versions:
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]: {   DHCP agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:     HyperV agent@hv-cinder-79388: {},
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:     L3 agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:     Metadata agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:     Metering agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:     Open vSwitch agent@dv-cinder-793885-1-iscsi: {   'AddressGroup': '1.2',
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:                                                      'ConntrackHelper': '1.0',
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:                                                      'Log': '1.0',
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:                                                      'Network': '1.1',
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:                                                      'Port': '1.7',
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:                                                      'PortForwarding': '1.2',
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:                                                      'QosPolicy': '1.8',
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:                                                      'SecurityGroup': '1.4',
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:                                                      'SecurityGroupRule': '1.2',
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:                                                      'SubPort': '1.0',
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:                                                      'Subnet': '1.1',
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:                                                      'Trunk': '1.1'}}
Jun 01 06:11:19.828873 dv-cinder-793885-1-iscsi neutron-server[92230]:  {{(pid=92230) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 06:11:19.835953 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:19.841763 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:19.842265 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.db.segments_db [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Added segment 7e12089c-d8cc-429c-8b7b-f5d148a55957 of type vlan for network 8c37e9ed-7031-4d7f-bfd1-3763eabba1b6
Jun 01 06:11:19.873963 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8788496565589'] for network, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:19.929036 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104'] for network, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:19.930691 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:19.931159 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:19.937617 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:19.944376 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 58726) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:19.987101 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 58732) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:20.018258 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 58738) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:20.039817 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Pushing event updated for resources: {'Network': ['ID=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:20.042479 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:20.053116 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Network 8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 details requested by agent ovs-agent-dv-cinder-793885-1-iscsi with host dv-cinder-793885-1-iscsi {{(pid=92231) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 06:11:20.070685 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 1.0785441
Jun 01 06:11:20.070933 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 58750) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:20.078440 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-c9a8b8d9-cc77-4c38-8ca0-7187cdcadd21 admin admin] Request body: {'subnet': {'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-173264809-subnet', 'tenant_id': 'b02068c8f29e4f5e9b3c965d023f7e29', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:20.085700 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-c9a8b8d9-cc77-4c38-8ca0-7187cdcadd21 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:20.092853 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-c9a8b8d9-cc77-4c38-8ca0-7187cdcadd21 admin admin] Usage tracker for resource:subnet and tenant:b02068c8f29e4f5e9b3c965d023f7e29 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:20.097369 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-c9a8b8d9-cc77-4c38-8ca0-7187cdcadd21 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:20.105970 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-c9a8b8d9-cc77-4c38-8ca0-7187cdcadd21 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:20.123737 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1575365070-network', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:20.130796 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:20.135551 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Usage tracker for resource:network and tenant:ac4006667c3442a3910d548e9e9d22c0 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:20.142447 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:20.149934 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:20.165553 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-921884409-network', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:20.181092 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-979777158-network', 'tenant_id': '8f1cf739e243401eb5da7ee705e856de'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:20.185586 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c9a8b8d9-cc77-4c38-8ca0-7187cdcadd21 admin admin] Made reservation on behalf of b02068c8f29e4f5e9b3c965d023f7e29 for: {'subnet': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:11:20.188346 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-c9a8b8d9-cc77-4c38-8ca0-7187cdcadd21 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:20.271540 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1460032359-network', 'tenant_id': '1e84732645d04c3dae887b1b3847cffe'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:20.292420 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Made reservation on behalf of ac4006667c3442a3910d548e9e9d22c0 for: {'network': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:11:20.296341 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-8110114'] for network, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:20.313727 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:20.319766 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Usage tracker for resource:network and tenant:1e84732645d04c3dae887b1b3847cffe is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:20.329374 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:20.341605 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:20.366651 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:20.376020 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:20.386099 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:20.392844 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Usage tracker for resource:network and tenant:8f1cf739e243401eb5da7ee705e856de is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:20.412625 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:20.417933 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Usage tracker for resource:network and tenant:0f63ca6fed3e47a6a676979240aef5c0 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:20.431052 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:20.437257 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:20.439722 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:20.452849 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Usage tracker for resource:security_group_rule and tenant:ac4006667c3442a3910d548e9e9d22c0 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:20.458172 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:20.462847 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:20.479505 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Made reservation on behalf of 1e84732645d04c3dae887b1b3847cffe for: {'network': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:11:20.482495 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-8110114'] for network, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:20.497578 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:20.508136 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:20.528602 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Made reservation on behalf of 0f63ca6fed3e47a6a676979240aef5c0 for: {'network': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:11:20.531352 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-8110114'] for network, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:20.540806 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Made reservation on behalf of 8f1cf739e243401eb5da7ee705e856de for: {'network': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:11:20.543336 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-8110114'] for network, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:20.573877 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:20.583948 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:20.594748 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:20.621811 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Usage tracker for resource:security_group_rule and tenant:1e84732645d04c3dae887b1b3847cffe is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:20.669973 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:20.685016 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:20.690585 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:20.695978 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:20.710036 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Usage tracker for resource:security_group_rule and tenant:0f63ca6fed3e47a6a676979240aef5c0 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:20.727027 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:20.745189 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Usage tracker for resource:security_group_rule and tenant:8f1cf739e243401eb5da7ee705e856de is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:20.758081 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:20.761669 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:20.790054 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:21.101239 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:21.108241 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:21.119238 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:21.131700 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:21.138273 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-79186c12-b3aa-423c-b2df-4c116dacae78 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:21.230067 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] vlan segment allocate from pool success with {'vlan_id': 224, 'physical_network': 'physnet1'}  {{(pid=92229) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 06:11:21.240267 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:21.240539 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.db.segments_db [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Added segment 5dda6d07-db2a-40a3-815e-42df1528c630 of type vlan for network 0890ab9c-2266-4ef4-af73-d3ff421b9bd7
Jun 01 06:11:21.307242 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] vlan segment allocate from pool success with {'vlan_id': 245, 'physical_network': 'physnet1'}  {{(pid=92229) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 06:11:21.337132 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e9cbf362-dbd3-4a0d-86bb-db72aa28914e,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:21.351916 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8788496565589'] for network, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:21.357350 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:21.357718 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.db.segments_db [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Added segment 79adeacf-7d8b-48ea-a63b-df4d7bfff135 of type vlan for network 5f973ed4-521b-4b78-9a54-1336b1302fa2
Jun 01 06:11:21.387635 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:21.394035 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:21.394889 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:21.395127 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:21.395465 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:21.396064 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:21.396901 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:21.397480 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:21.398102 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:21.398635 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:21.398960 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:21.399278 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:21.399582 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Tracked resource versions report:
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]: pushed versions:
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]: {   'AddressGroup': {'1.2'},
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:     'ConntrackHelper': {'1.0'},
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:     'Log': {'1.0'},
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:     'Network': {'1.1'},
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:     'Port': {'1.7'},
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:     'PortForwarding': {'1.2'},
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:     'QosPolicy': {'1.8'},
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:     'SecurityGroup': {'1.4'},
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:     'SecurityGroupRule': {'1.2'},
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:     'SubPort': {'1.0'},
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:     'Subnet': {'1.1'},
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:     'Trunk': {'1.1'}}
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]: consumer versions:
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]: {   DHCP agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:     HyperV agent@hv-cinder-79388: {},
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:     L3 agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:     Metadata agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:     Metering agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:     Open vSwitch agent@dv-cinder-793885-1-iscsi: {   'AddressGroup': '1.2',
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:                                                      'ConntrackHelper': '1.0',
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:                                                      'Log': '1.0',
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:                                                      'Network': '1.1',
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:                                                      'Port': '1.7',
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:                                                      'PortForwarding': '1.2',
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:                                                      'QosPolicy': '1.8',
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:                                                      'SecurityGroup': '1.4',
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:                                                      'SecurityGroupRule': '1.2',
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:                                                      'SubPort': '1.0',
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:                                                      'Subnet': '1.1',
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:                                                      'Trunk': '1.1'}}
Jun 01 06:11:21.400789 dv-cinder-793885-1-iscsi neutron-server[92229]:  {{(pid=92229) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 06:11:21.425913 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:21.501565 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8788496565589'] for network, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:21.541980 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] vlan segment allocate from pool success with {'vlan_id': 233, 'physical_network': 'physnet1'}  {{(pid=92229) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 06:11:21.545009 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2fb048dd-4226-46c8-832f-1144e8263e05,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:21.549188 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.412s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:21.552651 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:21.558578 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.297s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:21.566409 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104'] for network, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:21.578374 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:21.579276 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:21.583042 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:21.603923 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:21.604255 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.db.segments_db [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Added segment 2ae86fef-efbf-4f06-98a8-03571bcdb7ca of type vlan for network a3095bbd-0ae1-463e-b1b5-d29b58112d63
Jun 01 06:11:21.665984 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=322d6e24-5243-409c-8b80-acbe06176a3c,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:21.683535 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:21.687819 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] vlan segment allocate from pool success with {'vlan_id': 242, 'physical_network': 'physnet1'}  {{(pid=92229) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 06:11:21.692361 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104'] for network, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:21.692991 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.222s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:21.713351 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8788496565589'] for network, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:21.719251 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:21.719850 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:21.754763 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:21.755150 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.db.segments_db [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Added segment 1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e of type vlan for network 6e45a0e5-f930-4b18-8f4f-1693815eb31a
Jun 01 06:11:21.792975 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d0ab3203-d9c6-4a65-bc8f-4630202ec93a,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:21.812015 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:21.815925 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-9af64a80-5ef9-4b22-bf35-ddb23ecc174f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.217s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:21.832222 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 58802) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:21.832923 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 1.8865840
Jun 01 06:11:21.839155 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-21c1ed5e-8f42-4b9a-8ea9-69cb67b1b2f6 admin admin] Request body: {'subnet': {'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1575365070-subnet', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:21.848305 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-21c1ed5e-8f42-4b9a-8ea9-69cb67b1b2f6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:21.857712 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 889 time: 2.2257400
Jun 01 06:11:21.859753 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-21c1ed5e-8f42-4b9a-8ea9-69cb67b1b2f6 admin admin] Usage tracker for resource:subnet and tenant:ac4006667c3442a3910d548e9e9d22c0 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:21.870693 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-21c1ed5e-8f42-4b9a-8ea9-69cb67b1b2f6 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:21.870923 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 58808) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:21.884359 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-21c1ed5e-8f42-4b9a-8ea9-69cb67b1b2f6 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:21.903812 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-21c1ed5e-8f42-4b9a-8ea9-69cb67b1b2f6 admin admin] Made reservation on behalf of ac4006667c3442a3910d548e9e9d22c0 for: {'subnet': 1} {{(pid=92230) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:11:21.907321 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-21c1ed5e-8f42-4b9a-8ea9-69cb67b1b2f6 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:22.018621 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8788496565589'] for network, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:22.114973 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-248453de-58a7-4e37-9337-ce756fd0a73f admin admin] Request body: {'subnet': {'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-921884409-subnet', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:22.118893 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104'] for network, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:22.130920 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-248453de-58a7-4e37-9337-ce756fd0a73f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:22.149765 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:22.150636 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:22.185531 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-248453de-58a7-4e37-9337-ce756fd0a73f admin admin] Usage tracker for resource:subnet and tenant:0f63ca6fed3e47a6a676979240aef5c0 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:22.198431 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Pushing event updated for resources: {'Network': ['ID=0890ab9c-2266-4ef4-af73-d3ff421b9bd7,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:22.215122 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Network 0890ab9c-2266-4ef4-af73-d3ff421b9bd7 details requested by agent ovs-agent-dv-cinder-793885-1-iscsi with host dv-cinder-793885-1-iscsi {{(pid=92231) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 06:11:22.271560 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.db.resource_extend [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
Jun 01 06:11:22.329478 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-248453de-58a7-4e37-9337-ce756fd0a73f admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:22.354345 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-c9a8b8d9-cc77-4c38-8ca0-7187cdcadd21 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099'] for subnet, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:22.364218 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-248453de-58a7-4e37-9337-ce756fd0a73f admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:22.369194 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 885 time: 2.3479457
Jun 01 06:11:22.440825 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 58830) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:22.450449 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-76617628-d092-4ce2-b3e3-d95d10aa6f10 admin admin] Request body: {'subnet': {'network_id': 'a3095bbd-0ae1-463e-b1b5-d29b58112d63', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1460032359-subnet', 'tenant_id': '1e84732645d04c3dae887b1b3847cffe', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:22.457345 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-76617628-d092-4ce2-b3e3-d95d10aa6f10 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:22.465002 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-76617628-d092-4ce2-b3e3-d95d10aa6f10 admin admin] Usage tracker for resource:subnet and tenant:1e84732645d04c3dae887b1b3847cffe is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:22.469738 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-76617628-d092-4ce2-b3e3-d95d10aa6f10 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:22.477144 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-76617628-d092-4ce2-b3e3-d95d10aa6f10 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:22.510432 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-76617628-d092-4ce2-b3e3-d95d10aa6f10 admin admin] Made reservation on behalf of 1e84732645d04c3dae887b1b3847cffe for: {'subnet': 1} {{(pid=92230) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:11:22.514216 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-76617628-d092-4ce2-b3e3-d95d10aa6f10 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:22.522453 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104'] for network, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:22.589467 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:22.590362 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:22.654703 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-248453de-58a7-4e37-9337-ce756fd0a73f admin admin] Made reservation on behalf of 0f63ca6fed3e47a6a676979240aef5c0 for: {'subnet': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:11:22.664060 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-248453de-58a7-4e37-9337-ce756fd0a73f admin admin] Notify callbacks [] for subnet, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:22.729507 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Pushing event updated for resources: {'Network': ['ID=5f973ed4-521b-4b78-9a54-1336b1302fa2,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:22.745018 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.928s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:22.759497 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Network 5f973ed4-521b-4b78-9a54-1336b1302fa2 details requested by agent ovs-agent-dv-cinder-793885-1-iscsi with host dv-cinder-793885-1-iscsi {{(pid=92231) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 06:11:22.762626 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 1.137s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:22.763588 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.001s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:22.787129 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 1.053s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:22.836394 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 891 time: 2.8467855
Jun 01 06:11:22.848349 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 58842) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:22.854169 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-eb7875e6-732f-4fcd-b4c3-e13a466637fd admin admin] Request body: {'subnet': {'network_id': '6e45a0e5-f930-4b18-8f4f-1693815eb31a', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-979777158-subnet', 'tenant_id': '8f1cf739e243401eb5da7ee705e856de', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:22.870986 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-eb7875e6-732f-4fcd-b4c3-e13a466637fd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:22.875500 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-eb7875e6-732f-4fcd-b4c3-e13a466637fd admin admin] Usage tracker for resource:subnet and tenant:8f1cf739e243401eb5da7ee705e856de is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:22.878492 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-eb7875e6-732f-4fcd-b4c3-e13a466637fd admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:22.885761 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-eb7875e6-732f-4fcd-b4c3-e13a466637fd admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:22.903486 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eb7875e6-732f-4fcd-b4c3-e13a466637fd admin admin] Made reservation on behalf of 8f1cf739e243401eb5da7ee705e856de for: {'subnet': 1} {{(pid=92230) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:11:22.906752 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-eb7875e6-732f-4fcd-b4c3-e13a466637fd admin admin] Notify callbacks [] for subnet, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:23.011237 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Pushing event updated for resources: {'Network': ['ID=a3095bbd-0ae1-463e-b1b5-d29b58112d63,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:23.030658 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Network a3095bbd-0ae1-463e-b1b5-d29b58112d63 details requested by agent ovs-agent-dv-cinder-793885-1-iscsi with host dv-cinder-793885-1-iscsi {{(pid=92231) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 06:11:23.110765 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9a8b8d9-cc77-4c38-8ca0-7187cdcadd21 admin admin] Checking segment: {'id': '7e12089c-d8cc-429c-8b7b-f5d148a55957', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 206, 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:11:23.111080 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9a8b8d9-cc77-4c38-8ca0-7187cdcadd21 admin admin] Network hostable DHCP agents. Network: 8c37e9ed-7031-4d7f-bfd1-3763eabba1b6, hostable agents: ['648832f0-f26e-4e29-ac0d-d97e4a75c6c4'], hosted agents: [] {{(pid=92229) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 06:11:23.162477 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Pushing event updated for resources: {'Network': ['ID=6e45a0e5-f930-4b18-8f4f-1693815eb31a,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:23.167168 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.380s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:23.169696 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.995s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:23.170175 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.001s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:23.172330 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-7cf3076b-730e-4b3d-975a-fb5155f3ebf6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.689s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:23.177418 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Network 6e45a0e5-f930-4b18-8f4f-1693815eb31a details requested by agent ovs-agent-dv-cinder-793885-1-iscsi with host dv-cinder-793885-1-iscsi {{(pid=92231) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 06:11:23.213678 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9a8b8d9-cc77-4c38-8ca0-7187cdcadd21 admin admin] Network 8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 is scheduled to be hosted by DHCP agent 648832f0-f26e-4e29-ac0d-d97e4a75c6c4 with binding_index 1 {{(pid=92229) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 06:11:23.245323 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-c9a8b8d9-cc77-4c38-8ca0-7187cdcadd21 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793885-1-iscsi, 8c37e9ed-7031-4d7f-bfd1-3763eabba1b6) {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:11:23.252870 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-21c1ed5e-8f42-4b9a-8ea9-69cb67b1b2f6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099'] for subnet, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:23.275861 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:23.279533 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-08afea11-89e0-4285-8192-de0075a5ea37 None None] Network 8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:11:23.284156 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9a8b8d9-cc77-4c38-8ca0-7187cdcadd21 admin admin] Pushing event updated for resources: {'Subnet': ['ID=52a5c0c8-e902-4e55-bfa8-495f043331da,revision_number=0']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:23.298032 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9a8b8d9-cc77-4c38-8ca0-7187cdcadd21 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:23.298637 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-c9a8b8d9-cc77-4c38-8ca0-7187cdcadd21 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:23.329335 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-c9a8b8d9-cc77-4c38-8ca0-7187cdcadd21 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:23.374012 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.720s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:23.375283 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ad57c68a-c856-4257-8a96-14fe88570c9a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.001s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:23.422317 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-c9a8b8d9-cc77-4c38-8ca0-7187cdcadd21 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 3.3481586
Jun 01 06:11:23.423078 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21c1ed5e-8f42-4b9a-8ea9-69cb67b1b2f6 admin admin] Checking segment: {'id': '5dda6d07-db2a-40a3-815e-42df1528c630', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 224, 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92230) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:11:23.423711 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21c1ed5e-8f42-4b9a-8ea9-69cb67b1b2f6 admin admin] Network hostable DHCP agents. Network: 0890ab9c-2266-4ef4-af73-d3ff421b9bd7, hostable agents: ['648832f0-f26e-4e29-ac0d-d97e4a75c6c4'], hosted agents: [] {{(pid=92230) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 06:11:23.456351 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21c1ed5e-8f42-4b9a-8ea9-69cb67b1b2f6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3e980239-de35-45a0-8039-8395b5408617,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:23.464494 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-21c1ed5e-8f42-4b9a-8ea9-69cb67b1b2f6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.188s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:23.552352 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21c1ed5e-8f42-4b9a-8ea9-69cb67b1b2f6 admin admin] Network 0890ab9c-2266-4ef4-af73-d3ff421b9bd7 is scheduled to be hosted by DHCP agent 648832f0-f26e-4e29-ac0d-d97e4a75c6c4 with binding_index 1 {{(pid=92230) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 06:11:23.614364 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-21c1ed5e-8f42-4b9a-8ea9-69cb67b1b2f6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793885-1-iscsi, 0890ab9c-2266-4ef4-af73-d3ff421b9bd7) {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:11:23.631001 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21c1ed5e-8f42-4b9a-8ea9-69cb67b1b2f6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:23.631889 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-21c1ed5e-8f42-4b9a-8ea9-69cb67b1b2f6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:23.647641 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a87db689-e9bb-41dd-b64d-366dd3f9d062 None None] Network 0890ab9c-2266-4ef4-af73-d3ff421b9bd7 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:11:23.687449 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-76617628-d092-4ce2-b3e3-d95d10aa6f10 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099'] for subnet, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:23.696315 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-8a86e0ce-8f42-4ea8-b6f0-1ce667610ee0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:23.705267 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6dd96190-40f7-4b5b-87bf-c5b496662fc9 None None] Network 8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:11:23.741141 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-21c1ed5e-8f42-4b9a-8ea9-69cb67b1b2f6 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 847 time: 1.9076784
Jun 01 06:11:23.746507 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 58860) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:23.764674 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-248453de-58a7-4e37-9337-ce756fd0a73f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099'] for subnet, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:23.773393 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:23.814514 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1575365070-router', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:23.836166 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:23.850142 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76617628-d092-4ce2-b3e3-d95d10aa6f10 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5d7e3531-6a32-40da-9550-2584d9bd4210,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:23.856489 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Usage tracker for resource:router and tenant:ac4006667c3442a3910d548e9e9d22c0 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:23.872435 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:23.877638 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-76617628-d092-4ce2-b3e3-d95d10aa6f10 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:23.896644 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:23.916723 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-248453de-58a7-4e37-9337-ce756fd0a73f admin admin] Checking segment: {'id': '79adeacf-7d8b-48ea-a63b-df4d7bfff135', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 245, 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:11:23.917127 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-248453de-58a7-4e37-9337-ce756fd0a73f admin admin] Network hostable DHCP agents. Network: 5f973ed4-521b-4b78-9a54-1336b1302fa2, hostable agents: ['648832f0-f26e-4e29-ac0d-d97e4a75c6c4'], hosted agents: [] {{(pid=92229) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 06:11:23.936732 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-248453de-58a7-4e37-9337-ce756fd0a73f admin admin] Pushing event updated for resources: {'Subnet': ['ID=6137ee10-ce13-45c9-8edb-31811502bfd7,revision_number=0']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:23.943624 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76617628-d092-4ce2-b3e3-d95d10aa6f10 admin admin] Checking segment: {'id': '2ae86fef-efbf-4f06-98a8-03571bcdb7ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 233, 'network_id': 'a3095bbd-0ae1-463e-b1b5-d29b58112d63'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92230) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:11:23.944304 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-76617628-d092-4ce2-b3e3-d95d10aa6f10 admin admin] Network hostable DHCP agents. Network: a3095bbd-0ae1-463e-b1b5-d29b58112d63, hostable agents: ['648832f0-f26e-4e29-ac0d-d97e4a75c6c4'], hosted agents: [] {{(pid=92230) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 06:11:23.949035 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-248453de-58a7-4e37-9337-ce756fd0a73f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:23.961176 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-748217', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-677'] for router, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:23.962795 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-749241', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-745574', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-726667', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-686'] for router, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:23.985650 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-248453de-58a7-4e37-9337-ce756fd0a73f admin admin] Network 5f973ed4-521b-4b78-9a54-1336b1302fa2 is scheduled to be hosted by DHCP agent 648832f0-f26e-4e29-ac0d-d97e4a75c6c4 with binding_index 1 {{(pid=92229) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 06:11:23.999685 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-248453de-58a7-4e37-9337-ce756fd0a73f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793885-1-iscsi, 5f973ed4-521b-4b78-9a54-1336b1302fa2) {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:11:24.006907 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-248453de-58a7-4e37-9337-ce756fd0a73f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:24.008462 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-248453de-58a7-4e37-9337-ce756fd0a73f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:24.031569 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a5d11aad-0d08-404a-9055-9a44f3d01bfd None None] Network 5f973ed4-521b-4b78-9a54-1336b1302fa2 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:11:24.046795 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-248453de-58a7-4e37-9337-ce756fd0a73f admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 852 time: 2.1708832
Jun 01 06:11:24.047762 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 58880) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:24.058779 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-921884409-router', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:24.087868 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:24.102500 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Usage tracker for resource:router and tenant:0f63ca6fed3e47a6a676979240aef5c0 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:24.112167 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:24.134571 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:24.171238 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-eb7875e6-732f-4fcd-b4c3-e13a466637fd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099'] for subnet, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:24.173802 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-748217', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-677'] for router, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:24.175182 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-749241', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-745574', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-726667', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-686'] for router, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:24.185684 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-21c1ed5e-8f42-4b9a-8ea9-69cb67b1b2f6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:24.219041 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:24.223808 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-76617628-d092-4ce2-b3e3-d95d10aa6f10 admin admin] Network a3095bbd-0ae1-463e-b1b5-d29b58112d63 is scheduled to be hosted by DHCP agent 648832f0-f26e-4e29-ac0d-d97e4a75c6c4 with binding_index 1 {{(pid=92230) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 06:11:24.237689 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:24.393091 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-76617628-d092-4ce2-b3e3-d95d10aa6f10 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793885-1-iscsi, a3095bbd-0ae1-463e-b1b5-d29b58112d63) {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:11:24.411194 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-76617628-d092-4ce2-b3e3-d95d10aa6f10 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:24.412215 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-76617628-d092-4ce2-b3e3-d95d10aa6f10 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:24.473382 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb7875e6-732f-4fcd-b4c3-e13a466637fd admin admin] Pushing event updated for resources: {'Subnet': ['ID=84c296fc-69c0-46e2-b1ed-e3edf435b759,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:24.477119 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-eb7875e6-732f-4fcd-b4c3-e13a466637fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.292s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:24.523451 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-76617628-d092-4ce2-b3e3-d95d10aa6f10 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 849 time: 2.0800197
Jun 01 06:11:24.528742 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb7875e6-732f-4fcd-b4c3-e13a466637fd admin admin] Checking segment: {'id': '1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 242, 'network_id': '6e45a0e5-f930-4b18-8f4f-1693815eb31a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92230) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:11:24.529340 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb7875e6-732f-4fcd-b4c3-e13a466637fd admin admin] Network hostable DHCP agents. Network: 6e45a0e5-f930-4b18-8f4f-1693815eb31a, hostable agents: ['648832f0-f26e-4e29-ac0d-d97e4a75c6c4'], hosted agents: [] {{(pid=92230) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 06:11:24.544595 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4c9d941-d7f3-4e96-b251-35a71b87823b None None] Network a3095bbd-0ae1-463e-b1b5-d29b58112d63 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:11:24.692369 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 58912) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:24.703443 dv-cinder-793885-1-iscsi neutron-server[92229]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases.
Jun 01 06:11:24.707684 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb7875e6-732f-4fcd-b4c3-e13a466637fd admin admin] Network 6e45a0e5-f930-4b18-8f4f-1693815eb31a is scheduled to be hosted by DHCP agent 648832f0-f26e-4e29-ac0d-d97e4a75c6c4 with binding_index 1 {{(pid=92230) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 06:11:24.890522 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-eb7875e6-732f-4fcd-b4c3-e13a466637fd admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793885-1-iscsi, 6e45a0e5-f930-4b18-8f4f-1693815eb31a) {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:11:24.904405 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7875e6-732f-4fcd-b4c3-e13a466637fd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:24.905004 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-eb7875e6-732f-4fcd-b4c3-e13a466637fd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:24.944536 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4084d93a-8945-45f7-bb09-557a9e993c48 None None] Network 6e45a0e5-f930-4b18-8f4f-1693815eb31a requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:11:25.072027 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-eb7875e6-732f-4fcd-b4c3-e13a466637fd admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 855 time: 2.2202625
Jun 01 06:11:25.098479 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 58936) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:25.162411 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-745539', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-748171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-728'] for router, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:25.265424 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-745539', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-748171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-728'] for router, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:25.268527 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp5012ce77-b332-5f05-8982-a48a8fc8d50e-0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'fixed_ips': [{'subnet_id': '3e980239-de35-45a0-8039-8395b5408617'}]}} from dv-cinder-793885-1-iscsi. {{(pid=92231) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 06:11:25.269984 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:25.275841 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 58952) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:25.280622 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-979777158-router', 'tenant_id': '8f1cf739e243401eb5da7ee705e856de', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:25.412108 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:25.458239 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Usage tracker for resource:router and tenant:8f1cf739e243401eb5da7ee705e856de is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:25.470638 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:25.497851 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp5012ce77-b332-5f05-8982-a48a8fc8d50e-5f973ed4-521b-4b78-9a54-1336b1302fa2', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'fixed_ips': [{'subnet_id': '6137ee10-ce13-45c9-8edb-31811502bfd7'}]}} from dv-cinder-793885-1-iscsi. {{(pid=92231) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 06:11:25.498826 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:25.532487 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:25.597589 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-d82d3ed2-2d4d-4b68-aa22-6bb960a47a7f tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:25.598736 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-d82d3ed2-2d4d-4b68-aa22-6bb960a47a7f tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/networks?id=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 HTTP/1.1" status: 200  len: 814 time: 0.9015994
Jun 01 06:11:25.626419 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-748217', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-677'] for router, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:25.627022 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-749241', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-745574', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-726667', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-686'] for router, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:25.636740 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-26f2077d-cc3a-4be2-95c1-49a6efb5d785 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:25.637590 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-26f2077d-cc3a-4be2-95c1-49a6efb5d785 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Synchronizing usage tracker for tenant:1e84732645d04c3dae887b1b3847cffe on resource:network {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:11:25.660458 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-b34129cc-12ec-4683-9a18-89fcdbd746e5 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/quotas/b02068c8f29e4f5e9b3c965d023f7e29 HTTP/1.1" status: 200  len: 375 time: 0.0406077
Jun 01 06:11:25.673517 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:25.688059 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:25.708973 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:25.737913 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-26f2077d-cc3a-4be2-95c1-49a6efb5d785 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Unset dirty status for tenant:1e84732645d04c3dae887b1b3847cffe on resource:network {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:11:25.739189 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-26f2077d-cc3a-4be2-95c1-49a6efb5d785 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/networks?id=a3095bbd-0ae1-463e-b1b5-d29b58112d63 HTTP/1.1" status: 200  len: 812 time: 0.4543629
Jun 01 06:11:25.751021 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-1cec5009-307e-46a5-ac09-bc2e3a29db24 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=b02068c8f29e4f5e9b3c965d023f7e29&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0677109
Jun 01 06:11:25.788381 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-2cf55662-0d9b-4ca7-8874-29e983a66c5f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/quotas/1e84732645d04c3dae887b1b3847cffe HTTP/1.1" status: 200  len: 375 time: 0.0325580
Jun 01 06:11:25.876652 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.db_base_plugin_common [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Allocated IP 172.20.0.2 (0890ab9c-2266-4ef4-af73-d3ff421b9bd7/3e980239-de35-45a0-8039-8395b5408617/be4bfacb-b512-4361-b6c4-f38e7945c7aa) {{(pid=92231) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:11:25.901197 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_common [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Allocated IP 172.27.2.214 (83b812fb-2cfc-46e4-baa4-745218ea3ed2/a59d7d11-a92c-4b4f-83cf-2095ecee2b51/357a4df7-5d82-4e9d-b8d1-2190f63e3f9f) {{(pid=92230) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:11:25.967724 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-66f29515-3fab-4436-9abf-e2990bb061dd None None] Network a3095bbd-0ae1-463e-b1b5-d29b58112d63 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:11:25.973650 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-c2695bdc-0fcd-41d5-ba19-0e3d33f1ea8f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=1e84732645d04c3dae887b1b3847cffe&fields=id HTTP/1.1" status: 200  len: 210 time: 0.1819692
Jun 01 06:11:26.087065 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:26.183664 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:26.189580 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:26.219561 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de91a18a-d98c-4ef8-af2f-1572eff57cdd None None] Network 6e45a0e5-f930-4b18-8f4f-1693815eb31a requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:11:26.258284 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:11:26.261396 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:11:26.266715 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Received port after_create {{(pid=92230) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:11:26.303629 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-e2165c20-17cd-404f-a819-f349785ed738 service neutron] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=92229) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 06:11:26.304725 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-e2165c20-17cd-404f-a819-f349785ed738 service neutron] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3224134
Jun 01 06:11:26.339061 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Pushing event updated for resources: {'Port': ['ID=357a4df7-5d82-4e9d-b8d1-2190f63e3f9f,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:26.343901 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:26.403828 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.db_base_plugin_common [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Allocated IP 172.20.0.2 (5f973ed4-521b-4b78-9a54-1336b1302fa2/6137ee10-ce13-45c9-8edb-31811502bfd7/2307044b-54df-426e-9c5e-a4b02e59aecc) {{(pid=92231) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:11:26.423196 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-19b5ca5c-a724-4235-8c58-f199393cd6a5 service neutron] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=92229) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 06:11:26.424254 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-19b5ca5c-a724-4235-8c58-f199393cd6a5 service neutron] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3243239
Jun 01 06:11:26.433527 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-745539', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-748171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-728'] for router, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:26.627855 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-8bbe2cc9-4f76-4e65-a49e-879527363541 service neutron] 10.222.0.25 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3093789
Jun 01 06:11:26.778997 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Notify callbacks [] for port, precommit_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:26.783239 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:26.803473 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Transition to ACTIVE for port object be4bfacb-b512-4361-b6c4-f38e7945c7aa will not be triggered until provisioned by entity L2. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:11:26.805591 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-47b3f56d-a1d0-4a4a-b4c1-513f0e8d859a service neutron] 10.222.0.25 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1768732
Jun 01 06:11:26.843288 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Transition to ACTIVE for port object be4bfacb-b512-4361-b6c4-f38e7945c7aa will not be triggered until provisioned by entity DHCP. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:11:26.844448 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-fe8f415c-96dd-41df-b8b8-0953e803afda service neutron] 10.222.0.25 "GET /v2.0/networks/a3095bbd-0ae1-463e-b1b5-d29b58112d63?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4001350
Jun 01 06:11:26.894044 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:26.916317 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:26.972565 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Network 0890ab9c-2266-4ef4-af73-d3ff421b9bd7 is already hosted by enough agents. {{(pid=92231) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:11:26.982715 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.scheduler.base_scheduler [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Resources bound (agent type, host, resource id):  {{(pid=92231) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:11:26.992879 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Received port after_create {{(pid=92231) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:11:27.011933 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:27.017048 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Notify callbacks [] for port, precommit_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:27.105180 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:27.109252 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Transition to ACTIVE for port object 2307044b-54df-426e-9c5e-a4b02e59aecc will not be triggered until provisioned by entity L2. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:11:27.135442 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Transition to ACTIVE for port object 2307044b-54df-426e-9c5e-a4b02e59aecc will not be triggered until provisioned by entity DHCP. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:11:27.193174 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Pushing event updated for resources: {'Port': ['ID=be4bfacb-b512-4361-b6c4-f38e7945c7aa,revision_number=1']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:27.232091 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:27.236486 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Attempting to bind port be4bfacb-b512-4361-b6c4-f38e7945c7aa on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:11:27.236726 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Attempting to bind port be4bfacb-b512-4361-b6c4-f38e7945c7aa by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': '5dda6d07-db2a-40a3-815e-42df1528c630', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 224, 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7'}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:11:27.237085 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Attempting to bind port be4bfacb-b512-4361-b6c4-f38e7945c7aa on network 0890ab9c-2266-4ef4-af73-d3ff421b9bd7 {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:11:27.248710 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 11, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:11:27.248934 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Checking segment: {'id': '5dda6d07-db2a-40a3-815e-42df1528c630', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 224, 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92231) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:11:27.249341 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:27.249731 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Bound using segment: {'id': '5dda6d07-db2a-40a3-815e-42df1528c630', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 224, 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7'} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:11:27.250381 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Bound port: be4bfacb-b512-4361-b6c4-f38e7945c7aa, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5dda6d07-db2a-40a3-815e-42df1528c630', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 224, 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7'}}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:11:27.250961 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:27.278970 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:27.279324 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:27.279652 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:27.279995 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:27.280310 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:27.280761 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:27.281218 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:27.281538 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:27.281875 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:27.282081 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Allocated IP 172.27.2.20 (83b812fb-2cfc-46e4-baa4-745218ea3ed2/a59d7d11-a92c-4b4f-83cf-2095ecee2b51/15dfae58-2fa8-4151-bc0e-796ec182e152) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:11:27.282381 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:27.282746 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:27.283045 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Tracked resource versions report:
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]: pushed versions:
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]: {   'AddressGroup': {'1.2'},
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:     'ConntrackHelper': {'1.0'},
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:     'Log': {'1.0'},
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:     'Network': {'1.1'},
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:     'Port': {'1.7'},
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:     'PortForwarding': {'1.2'},
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:     'QosPolicy': {'1.8'},
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:     'SecurityGroup': {'1.4'},
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:     'SecurityGroupRule': {'1.2'},
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:     'SubPort': {'1.0'},
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:     'Subnet': {'1.1'},
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:     'Trunk': {'1.1'}}
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]: consumer versions:
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]: {   DHCP agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:     HyperV agent@hv-cinder-79388: {},
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:     L3 agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:     Metadata agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:     Metering agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:     Open vSwitch agent@dv-cinder-793885-1-iscsi: {   'AddressGroup': '1.2',
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:                                                      'ConntrackHelper': '1.0',
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:                                                      'Log': '1.0',
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:                                                      'Network': '1.1',
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:                                                      'Port': '1.7',
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:                                                      'PortForwarding': '1.2',
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:                                                      'QosPolicy': '1.8',
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:                                                      'SecurityGroup': '1.4',
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:                                                      'SecurityGroupRule': '1.2',
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:                                                      'SubPort': '1.0',
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:                                                      'Subnet': '1.1',
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:                                                      'Trunk': '1.1'}}
Jun 01 06:11:27.284145 dv-cinder-793885-1-iscsi neutron-server[92231]:  {{(pid=92231) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 06:11:27.298288 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-748208', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-745472'] for router, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:27.431310 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] For port be4bfacb-b512-4361-b6c4-f38e7945c7aa, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92231) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:11:27.435931 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] For port be4bfacb-b512-4361-b6c4-f38e7945c7aa, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=be4bfacb-b512-4361-b6c4-f38e7945c7aa,segment=NetworkSegment(5dda6d07-db2a-40a3-815e-42df1528c630),segment_id=5dda6d07-db2a-40a3-815e-42df1528c630)] {{(pid=92231) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:11:27.440801 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.524s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:27.441276 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.005s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:27.492930 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-65707cfe-6841-4c0a-b0ad-b2b5e9a5ca15 req-839ebd60-d2da-4644-8011-d527b50bb06b tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 210 time: 0.0907793
Jun 01 06:11:27.512869 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:27.521196 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Network 5f973ed4-521b-4b78-9a54-1336b1302fa2 is already hosted by enough agents. {{(pid=92231) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:11:27.535675 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.scheduler.base_scheduler [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Resources bound (agent type, host, resource id):  {{(pid=92231) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:11:27.541058 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Received port after_create {{(pid=92231) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:11:27.543461 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Pushing event updated for resources: {'Port': ['ID=2307044b-54df-426e-9c5e-a4b02e59aecc,revision_number=1']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:27.585943 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:27.586497 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.053s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:27.593844 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-ae96e3b3-0fe2-406f-b59c-55ca3852840d service neutron] 10.222.0.25 "GET /v2.0/networks/a3095bbd-0ae1-463e-b1b5-d29b58112d63?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6070731
Jun 01 06:11:27.604704 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:27.616753 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Router f8aef563-57d3-45c3-afd4-23442c8f572d is scheduled to L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 with binding_index 1 {{(pid=92230) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 06:11:27.859185 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Attempting to bind port 2307044b-54df-426e-9c5e-a4b02e59aecc on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:11:27.859466 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Attempting to bind port 2307044b-54df-426e-9c5e-a4b02e59aecc by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': '79adeacf-7d8b-48ea-a63b-df4d7bfff135', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 245, 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2'}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:11:27.859997 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Attempting to bind port 2307044b-54df-426e-9c5e-a4b02e59aecc on network 5f973ed4-521b-4b78-9a54-1336b1302fa2 {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:11:27.863410 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:27.877485 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-92f03cab-4bfa-46b1-8911-1a81557a1246 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:27.880944 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 11, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:11:27.881730 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Checking segment: {'id': '79adeacf-7d8b-48ea-a63b-df4d7bfff135', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 245, 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92231) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:11:27.882623 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:27.883489 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Bound using segment: {'id': '79adeacf-7d8b-48ea-a63b-df4d7bfff135', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 245, 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2'} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:11:27.884650 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Bound port: 2307044b-54df-426e-9c5e-a4b02e59aecc, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '79adeacf-7d8b-48ea-a63b-df4d7bfff135', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 245, 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2'}}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:11:27.885461 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:27.908012 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Pushing event updated for resources: {'Port': ['ID=be4bfacb-b512-4361-b6c4-f38e7945c7aa,revision_number=2']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:27.932083 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.345s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:28.082777 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:11:28.093272 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:11:28.154387 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] For port 2307044b-54df-426e-9c5e-a4b02e59aecc, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92231) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:11:28.161168 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] For port 2307044b-54df-426e-9c5e-a4b02e59aecc, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=2307044b-54df-426e-9c5e-a4b02e59aecc,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:11:28.168418 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:28.175612 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:28.249284 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:11:28.263364 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] Sync routers for ids ['f8aef563-57d3-45c3-afd4-23442c8f572d'] in dv-cinder-793885-1-iscsi {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:11:28.267294 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:11:28.279939 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] Routers {'f8aef563-57d3-45c3-afd4-23442c8f572d'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:11:28.280581 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b23c8e80>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:11:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['f8aef563-57d3-45c3-afd4-23442c8f572d'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:11:28.333342 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Notify callbacks [] for router, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:28.335637 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201  len: 923 time: 4.5805063
Jun 01 06:11:28.338186 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 59046) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:28.392264 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Pushing event updated for resources: {'Port': ['ID=2307044b-54df-426e-9c5e-a4b02e59aecc,revision_number=2']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:28.424317 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.249s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:28.659467 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] Set router f8aef563-57d3-45c3-afd4-23442c8f572d gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:11:28.678937 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-65225ee9-f5bc-4b2e-92eb-f5dd47d77582 req-582a2c1b-5e39-4372-b51b-e19c72ec7a5f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/ports?device_id=b662816d-f3d5-434d-b2c3-eb501ac85556 HTTP/1.1" status: 200  len: 210 time: 0.6041641
Jun 01 06:11:28.681135 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Pushing event updated for resources: {'Port': ['ID=15dfae58-2fa8-4151-bc0e-796ec182e152,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:28.734244 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.857s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:28.843033 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:28.973801 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:29.239687 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-58696cbb-73ca-4950-9919-306bca28ffa9 req-cc41e9b1-7322-4ff1-8164-7db8e0483cad tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 210 time: 0.1595535
Jun 01 06:11:29.424944 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 2307044b-54df-426e-9c5e-a4b02e59aecc up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:11:29.428279 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b23c8e80>, [{'id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'name': 'tempest-AttachVolumeTestJSON-1575365070-router', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214'}], 'enable_snat': True}, 'gw_port_id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:23Z', 'updated_at': '2021-06-01T06:11:26Z', 'revision_number': 3, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'gw_port': {'id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:02:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:25Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:11:29.442510 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] Checking router: f8aef563-57d3-45c3-afd4-23442c8f572d for host: dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:11:29.443119 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] Updating router f8aef563-57d3-45c3-afd4-23442c8f572d port 357a4df7-5d82-4e9d-b8d1-2190f63e3f9f binding host dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 06:11:29.577033 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:29.601729 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port 2307044b-54df-426e-9c5e-a4b02e59aecc completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:11:29.610759 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device be4bfacb-b512-4361-b6c4-f38e7945c7aa up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:11:29.736927 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dabbd1f5-b2f8-4f43-8c78-22f35a5f9c99 None None] Network 0890ab9c-2266-4ef4-af73-d3ff421b9bd7 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:11:29.821891 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:11:29.888406 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cb621c0c-0c3e-4f16-8170-baf11a1e9d81 req-4810032f-fd4d-42c2-b661-5dfa7c1fe602 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/ports?device_id=b662816d-f3d5-434d-b2c3-eb501ac85556 HTTP/1.1" status: 200  len: 210 time: 0.0667243
Jun 01 06:11:29.897042 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Allocated IP 172.27.2.222 (83b812fb-2cfc-46e4-baa4-745218ea3ed2/a59d7d11-a92c-4b4f-83cf-2095ecee2b51/e157eec0-3394-4fbf-8701-c05f500f506a) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:11:29.923425 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:29.997075 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:30.020341 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-80122c3b-07fb-4e32-b5db-6732c17c144f None None] Network 5f973ed4-521b-4b78-9a54-1336b1302fa2 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:11:30.050109 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-2069078b-c577-41cf-b435-524edef9a826 None None] Provisioning for port be4bfacb-b512-4361-b6c4-f38e7945c7aa completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:11:30.213069 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port be4bfacb-b512-4361-b6c4-f38e7945c7aa completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:11:30.238482 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port be4bfacb-b512-4361-b6c4-f38e7945c7aa triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:11:30.238857 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:30.321042 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:30.367364 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_common [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] Allocated IP 172.20.0.1 (0890ab9c-2266-4ef4-af73-d3ff421b9bd7/3e980239-de35-45a0-8039-8395b5408617/8e48657d-a82c-420f-8462-d947f458adb4) {{(pid=92230) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:11:30.408833 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-119605c0-d1b2-4c53-9a4b-393844391656 None None] Provisioning for port 2307044b-54df-426e-9c5e-a4b02e59aecc completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:11:30.428754 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-119605c0-d1b2-4c53-9a4b-393844391656 None None] Provisioning complete for port 2307044b-54df-426e-9c5e-a4b02e59aecc triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:11:30.429742 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-119605c0-d1b2-4c53-9a4b-393844391656 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:30.472047 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d1bbada-2c06-4096-b3e8-22b7f757c337 req-93396ddd-fb6a-48ea-b5b4-41d035313773 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 210 time: 0.0601821
Jun 01 06:11:30.510272 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-748208', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-745472'] for router, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:30.589916 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:30.608807 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-bcb61455-5901-460f-8183-3723f7cbec8b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:30.633226 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:30.680049 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] Notify callbacks [] for port, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:30.699023 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.provisioning_blocks [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] Transition to ACTIVE for port object 8e48657d-a82c-420f-8462-d947f458adb4 will not be triggered until provisioned by entity DHCP. {{(pid=92230) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:11:30.714769 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:11:30.720100 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:11:30.733479 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:30.738945 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:30.780426 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port be4bfacb-b512-4361-b6c4-f38e7945c7aa, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=be4bfacb-b512-4361-b6c4-f38e7945c7aa,segment=NetworkSegment(5dda6d07-db2a-40a3-815e-42df1528c630),segment_id=5dda6d07-db2a-40a3-815e-42df1528c630)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:11:30.782557 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-119605c0-d1b2-4c53-9a4b-393844391656 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:30.796148 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:11:30.805977 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:30.817374 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:30.849960 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] Notify callbacks [] for port, precommit_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:30.868679 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.provisioning_blocks [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] Transition to ACTIVE for port object 357a4df7-5d82-4e9d-b8d1-2190f63e3f9f will not be triggered until provisioned by entity L2. {{(pid=92232) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:11:30.878873 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] Network 0890ab9c-2266-4ef4-af73-d3ff421b9bd7 is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:11:30.880534 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:11:30.886133 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:30.892043 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:30.900277 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] Received port after_create {{(pid=92230) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:11:30.902325 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-744049'] for router_interface, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:30.963301 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-119605c0-d1b2-4c53-9a4b-393844391656 None None] For port 2307044b-54df-426e-9c5e-a4b02e59aecc, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=2307044b-54df-426e-9c5e-a4b02e59aecc,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:11:30.981870 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-119605c0-d1b2-4c53-9a4b-393844391656 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:31.001613 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=be4bfacb-b512-4361-b6c4-f38e7945c7aa,revision_number=3']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:31.014949 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.194s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:31.014949 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.015s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:31.102043 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-119605c0-d1b2-4c53-9a4b-393844391656 None None] Pushing event updated for resources: {'Port': ['ID=2307044b-54df-426e-9c5e-a4b02e59aecc,revision_number=3']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:31.108626 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-119605c0-d1b2-4c53-9a4b-393844391656 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:31.118990 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-79dc896a-263b-42c2-afe2-4cc9e6176e57 None None] Provisioning complete for port be4bfacb-b512-4361-b6c4-f38e7945c7aa triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:11:31.119690 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-79dc896a-263b-42c2-afe2-4cc9e6176e57 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:31.136554 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-165205a5-e3f1-4a1a-b169-f611156b79e8 None None] Pushing event updated for resources: {'Port': ['ID=357a4df7-5d82-4e9d-b8d1-2190f63e3f9f,revision_number=2']} {{(pid=92232) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:31.167909 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-165205a5-e3f1-4a1a-b169-f611156b79e8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:31.168247 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-165205a5-e3f1-4a1a-b169-f611156b79e8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:31.172189 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-165205a5-e3f1-4a1a-b169-f611156b79e8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:31.172562 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-165205a5-e3f1-4a1a-b169-f611156b79e8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:31.172938 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-165205a5-e3f1-4a1a-b169-f611156b79e8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:31.173270 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-165205a5-e3f1-4a1a-b169-f611156b79e8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:31.173592 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-165205a5-e3f1-4a1a-b169-f611156b79e8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:31.173906 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-165205a5-e3f1-4a1a-b169-f611156b79e8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:31.175936 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-165205a5-e3f1-4a1a-b169-f611156b79e8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:31.176391 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-165205a5-e3f1-4a1a-b169-f611156b79e8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:31.176598 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-165205a5-e3f1-4a1a-b169-f611156b79e8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:31.176918 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-165205a5-e3f1-4a1a-b169-f611156b79e8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-165205a5-e3f1-4a1a-b169-f611156b79e8 None None] Tracked resource versions report:
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]: pushed versions:
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]: {   'AddressGroup': {'1.2'},
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:     'ConntrackHelper': {'1.0'},
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:     'Log': {'1.0'},
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:     'Network': {'1.1'},
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:     'Port': {'1.7'},
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:     'PortForwarding': {'1.2'},
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:     'QosPolicy': {'1.8'},
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:     'SecurityGroup': {'1.4'},
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:     'SecurityGroupRule': {'1.2'},
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:     'SubPort': {'1.0'},
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:     'Subnet': {'1.1'},
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:     'Trunk': {'1.1'}}
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]: consumer versions:
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]: {   DHCP agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:     HyperV agent@hv-cinder-79388: {},
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:     L3 agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:     Metadata agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:     Metering agent@dv-cinder-793885-1-iscsi: {},
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:     Open vSwitch agent@dv-cinder-793885-1-iscsi: {   'AddressGroup': '1.2',
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:                                                      'ConntrackHelper': '1.0',
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:                                                      'Log': '1.0',
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:                                                      'Network': '1.1',
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:                                                      'Port': '1.7',
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:                                                      'PortForwarding': '1.2',
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:                                                      'QosPolicy': '1.8',
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:                                                      'SecurityGroup': '1.4',
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:                                                      'SecurityGroupRule': '1.2',
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:                                                      'SubPort': '1.0',
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:                                                      'Subnet': '1.1',
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:                                                      'Trunk': '1.1'}}
Jun 01 06:11:31.177943 dv-cinder-793885-1-iscsi neutron-server[92232]:  {{(pid=92232) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 06:11:31.182050 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Pushing event updated for resources: {'Port': ['ID=e157eec0-3394-4fbf-8701-c05f500f506a,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:31.188843 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-165205a5-e3f1-4a1a-b169-f611156b79e8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.296s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:31.203070 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.591s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:31.258803 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] Attempting to bind port 357a4df7-5d82-4e9d-b8d1-2190f63e3f9f on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:11:31.259058 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] Attempting to bind port 357a4df7-5d82-4e9d-b8d1-2190f63e3f9f by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}] {{(pid=92232) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:11:31.259425 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] Attempting to bind port 357a4df7-5d82-4e9d-b8d1-2190f63e3f9f on network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:11:31.279207 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 11, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:11:31.279831 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] Checking segment: {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92232) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:11:31.280256 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:31.280655 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] Bound using segment: {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'} {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:11:31.283730 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] Bound port: 357a4df7-5d82-4e9d-b8d1-2190f63e3f9f, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}}] {{(pid=92232) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:11:31.284206 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:31.305568 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device be4bfacb-b512-4361-b6c4-f38e7945c7aa up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:11:31.401995 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] Pushing event updated for resources: {'Port': ['ID=8e48657d-a82c-420f-8462-d947f458adb4,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:31.409735 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.671s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:31.462229 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.db [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] For port 357a4df7-5d82-4e9d-b8d1-2190f63e3f9f, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92232) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:11:31.468770 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.db [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] For port 357a4df7-5d82-4e9d-b8d1-2190f63e3f9f, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=357a4df7-5d82-4e9d-b8d1-2190f63e3f9f,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92232) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:11:31.479767 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:31.497540 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:31.543013 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c44e5155-1fce-429f-89a8-b48cced73e8b req-976a58fb-e4f0-4c5e-aa07-a88b20f6161b tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/ports?device_id=b662816d-f3d5-434d-b2c3-eb501ac85556 HTTP/1.1" status: 200  len: 210 time: 0.2026513
Jun 01 06:11:31.582979 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port be4bfacb-b512-4361-b6c4-f38e7945c7aa triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:11:31.583896 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:31.770082 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-977ecd75-a060-428c-8d6c-6ebe5a5c59eb None None] Provisioning complete for port 2307044b-54df-426e-9c5e-a4b02e59aecc triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:11:31.770851 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-977ecd75-a060-428c-8d6c-6ebe5a5c59eb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:31.816232 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] Routers {'f8aef563-57d3-45c3-afd4-23442c8f572d'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:11:31.816905 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b23c8e80>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:11:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['f8aef563-57d3-45c3-afd4-23442c8f572d'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:11:31.829756 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:31.854654 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cddf970f-0d80-4fac-a21f-742d05e10eaf req-36c44019-236c-4e8c-be7d-7891260cebd9 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 210 time: 0.0772111
Jun 01 06:11:31.960799 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Router b7bdc21e-592c-4bbf-87c9-5eba5676579e is scheduled to L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 with binding_index 1 {{(pid=92229) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 06:11:31.980860 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-165205a5-e3f1-4a1a-b169-f611156b79e8 None None] Pushing event updated for resources: {'Port': ['ID=357a4df7-5d82-4e9d-b8d1-2190f63e3f9f,revision_number=3']} {{(pid=92232) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:31.988013 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-165205a5-e3f1-4a1a-b169-f611156b79e8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.491s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:32.030015 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-977ecd75-a060-428c-8d6c-6ebe5a5c59eb None None] Provisioning for port 8e48657d-a82c-420f-8462-d947f458adb4 completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:11:32.035833 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-977ecd75-a060-428c-8d6c-6ebe5a5c59eb None None] Provisioning complete for port 8e48657d-a82c-420f-8462-d947f458adb4 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:11:32.036194 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-977ecd75-a060-428c-8d6c-6ebe5a5c59eb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:32.174874 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-977ecd75-a060-428c-8d6c-6ebe5a5c59eb None None] Port 8e48657d-a82c-420f-8462-d947f458adb4 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:11:32.203020 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.48', 58072) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:32.252144 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] Set router f8aef563-57d3-45c3-afd4-23442c8f572d gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:11:32.279563 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:32.441836 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] Notify callbacks [] for port, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:32.455361 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-337137dc-3d5c-461e-aa75-a2cd2caad697 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:32.457319 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-337137dc-3d5c-461e-aa75-a2cd2caad697 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.48 "GET /v2.0/networks?id=a3095bbd-0ae1-463e-b1b5-d29b58112d63 HTTP/1.1" status: 200  len: 812 time: 0.2531810
Jun 01 06:11:32.458651 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:32.459999 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-582666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-744156'] for router_interface, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:32.465274 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-0a442ad3-69d2-413f-9bd6-f9fe36905799 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:32.528628 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-ac2363b0-b056-4cab-b5ba-74e62a59635f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Request body: {'port': {'device_id': 'b662816d-f3d5-434d-b2c3-eb501ac85556', 'network_id': 'a3095bbd-0ae1-463e-b1b5-d29b58112d63', 'admin_state_up': True, 'tenant_id': '1e84732645d04c3dae887b1b3847cffe'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:32.816260 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92229) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:11:32.823657 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] Network 0890ab9c-2266-4ef4-af73-d3ff421b9bd7 is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:11:32.833959 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] Sync routers for ids ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:11:32.852234 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] Routers {'b7bdc21e-592c-4bbf-87c9-5eba5676579e'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:11:32.853222 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b210f1c0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:11:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:11:33.010162 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 59170) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:33.047057 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Notify callbacks [] for router, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:33.048615 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201  len: 927 time: 8.9998298
Jun 01 06:11:33.066014 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7f58589a-0614-47fb-8413-b656ecba00e1 req-d7cc57e4-eb7e-48df-ad3d-b5f381fddb9c tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/ports?device_id=b662816d-f3d5-434d-b2c3-eb501ac85556 HTTP/1.1" status: 200  len: 210 time: 0.2334573
Jun 01 06:11:33.067812 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 59184) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:33.068346 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.48', 58079) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:33.231713 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:11:33.264957 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-ac2363b0-b056-4cab-b5ba-74e62a59635f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:33.283814 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-ac2363b0-b056-4cab-b5ba-74e62a59635f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Usage tracker for resource:port and tenant:1e84732645d04c3dae887b1b3847cffe is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:33.291350 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b23c8e80>, [{'id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'name': 'tempest-AttachVolumeTestJSON-1575365070-router', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214'}], 'enable_snat': True}, 'gw_port_id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:23Z', 'updated_at': '2021-06-01T06:11:31Z', 'revision_number': 4, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'gw_port': {'id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:02:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '8e48657d-a82c-420f-8462-d947f458adb4', 'name': '', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'mac_address': 'fa:16:3e:9f:72:38', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '3e980239-de35-45a0-8039-8395b5408617', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:30Z', 'updated_at': '2021-06-01T06:11:30Z', 'revision_number': 1, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'subnets': [{'id': '3e980239-de35-45a0-8039-8395b5408617', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:11:33.294014 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-ac2363b0-b056-4cab-b5ba-74e62a59635f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:33.304270 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] Pushing event updated for resources: {'Port': ['ID=8e48657d-a82c-420f-8462-d947f458adb4,revision_number=2']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:33.306454 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6384f5cf-f2ff-4b33-b04e-3f166a7d145e None None] The sync data for ids ['f8aef563-57d3-45c3-afd4-23442c8f572d'] in dv-cinder-793885-1-iscsi is: [{'id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'name': 'tempest-AttachVolumeTestJSON-1575365070-router', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214'}], 'enable_snat': True}, 'gw_port_id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:23Z', 'updated_at': '2021-06-01T06:11:31Z', 'revision_number': 4, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'gw_port': {'id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:02:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '8e48657d-a82c-420f-8462-d947f458adb4', 'name': '', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'mac_address': 'fa:16:3e:9f:72:38', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '3e980239-de35-45a0-8039-8395b5408617', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:30Z', 'updated_at': '2021-06-01T06:11:30Z', 'revision_number': 1, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'subnets': [{'id': '3e980239-de35-45a0-8039-8395b5408617', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:11:33.311751 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.846s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:33.458162 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 2307044b-54df-426e-9c5e-a4b02e59aecc up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:11:33.587495 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-ac2363b0-b056-4cab-b5ba-74e62a59635f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:33.643693 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-ac2363b0-b056-4cab-b5ba-74e62a59635f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Made reservation on behalf of 1e84732645d04c3dae887b1b3847cffe for: {'port': 1} {{(pid=92230) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:11:33.662910 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-ac2363b0-b056-4cab-b5ba-74e62a59635f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:33.733785 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-773572aa-8b08-4dea-9a3d-7b671d0e6981 None None] Provisioning complete for port 8e48657d-a82c-420f-8462-d947f458adb4 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:11:33.733785 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-773572aa-8b08-4dea-9a3d-7b671d0e6981 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:33.815812 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] Set router b7bdc21e-592c-4bbf-87c9-5eba5676579e gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:11:33.829058 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-51ced49e-a3df-4f92-970f-b96efecffcb0 req-c4d13142-60ff-4084-b2fb-a18505a19ee4 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 210 time: 0.4776621
Jun 01 06:11:33.836749 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-9cfa5b9d-3547-4d1b-810d-02e41a82900b tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:33.850945 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-9cfa5b9d-3547-4d1b-810d-02e41a82900b tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.48 "GET /v2.0/networks?id=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 HTTP/1.1" status: 200  len: 814 time: 0.7652779
Jun 01 06:11:33.885314 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 2307044b-54df-426e-9c5e-a4b02e59aecc triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:11:33.886199 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:34.023319 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] Router f8aef563-57d3-45c3-afd4-23442c8f572d has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92230) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:11:34.045395 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b356a992-140f-4da8-bcaf-8b1bb8000284 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:34.095111 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-907ebe46-b106-4923-9880-06ca8cd4a7ec tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Request body: {'port': {'device_id': '5967d75f-2870-4a80-98ec-b2547cff266e', 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6', 'admin_state_up': True, 'tenant_id': 'b02068c8f29e4f5e9b3c965d023f7e29'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:34.117007 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-b356a992-140f-4da8-bcaf-8b1bb8000284 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:34.122060 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-b356a992-140f-4da8-bcaf-8b1bb8000284 admin admin] Usage tracker for resource:security_group_rule and tenant:dec9257b87914e539241e969ecd4dc4b is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:34.125419 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-b356a992-140f-4da8-bcaf-8b1bb8000284 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:34.133441 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-b356a992-140f-4da8-bcaf-8b1bb8000284 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:34.342157 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b356a992-140f-4da8-bcaf-8b1bb8000284 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:34.363887 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 59236) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:34.414372 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b356a992-140f-4da8-bcaf-8b1bb8000284 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:34.428458 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-773572aa-8b08-4dea-9a3d-7b671d0e6981 None None] Port 8e48657d-a82c-420f-8462-d947f458adb4 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:11:34.725990 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:11:34.785879 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] 10.222.0.25 "PUT /v2.0/routers/f8aef563-57d3-45c3-afd4-23442c8f572d/add_router_interface HTTP/1.1" status: 200  len: 503 time: 6.4439297
Jun 01 06:11:34.815283 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_common [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-ac2363b0-b056-4cab-b5ba-74e62a59635f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Allocated IP 172.20.0.14 (a3095bbd-0ae1-463e-b1b5-d29b58112d63/5d7e3531-6a32-40da-9550-2584d9bd4210/dad38687-d35c-4b39-9dd6-26cb8f3ec5a7) {{(pid=92230) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:11:35.054000 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b210f1c0>, [{'id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'name': 'tempest-AttachVolumeShelveTestJSON-921884409-router', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20'}], 'enable_snat': True}, 'gw_port_id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:24Z', 'updated_at': '2021-06-01T06:11:28Z', 'revision_number': 3, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'gw_port': {'id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:b4:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:27Z', 'updated_at': '2021-06-01T06:11:27Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:11:35.063052 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] Checking router: b7bdc21e-592c-4bbf-87c9-5eba5676579e for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:11:35.063419 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] Updating router b7bdc21e-592c-4bbf-87c9-5eba5676579e port 15dfae58-2fa8-4151-bc0e-796ec182e152 binding host dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 06:11:35.213222 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:35.263116 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:35.333176 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 357a4df7-5d82-4e9d-b8d1-2190f63e3f9f up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:11:35.422235 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bd1daff7-6244-4fce-aea9-26bea583cc45 req-67aaa8e8-60d4-4308-9db1-50f7ec50ef8b tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/ports?device_id=b662816d-f3d5-434d-b2c3-eb501ac85556 HTTP/1.1" status: 200  len: 210 time: 1.0362844
Jun 01 06:11:35.446434 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-ac2363b0-b056-4cab-b5ba-74e62a59635f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Notify callbacks [] for port, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:35.486641 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-ac2363b0-b056-4cab-b5ba-74e62a59635f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:35.505381 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:35.594103 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b356a992-140f-4da8-bcaf-8b1bb8000284 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=33a40c0b-b4f0-438c-a114-517aebf947de,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:35.601791 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-b356a992-140f-4da8-bcaf-8b1bb8000284 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=dec9257b87914e539241e969ecd4dc4b&name=default HTTP/1.1" status: 200  len: 2975 time: 2.5736134
Jun 01 06:11:35.603888 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 59262) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:35.646303 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac2363b0-b056-4cab-b5ba-74e62a59635f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Pushing event updated for resources: {'Port': ['ID=dad38687-d35c-4b39-9dd6-26cb8f3ec5a7,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:35.651341 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-ac2363b0-b056-4cab-b5ba-74e62a59635f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:35.658611 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-ac2363b0-b056-4cab-b5ba-74e62a59635f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Network a3095bbd-0ae1-463e-b1b5-d29b58112d63 is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:11:35.660250 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-ac2363b0-b056-4cab-b5ba-74e62a59635f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:11:35.672865 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-ac2363b0-b056-4cab-b5ba-74e62a59635f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Received port after_create {{(pid=92230) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:11:35.681439 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-ac2363b0-b056-4cab-b5ba-74e62a59635f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:35.682407 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-ac2363b0-b056-4cab-b5ba-74e62a59635f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for port, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:35.686884 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-748208', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-745472'] for router, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:35.702817 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b356a992-140f-4da8-bcaf-8b1bb8000284 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.441s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:35.726874 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-ac2363b0-b056-4cab-b5ba-74e62a59635f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 3.2034121
Jun 01 06:11:35.889904 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port 357a4df7-5d82-4e9d-b8d1-2190f63e3f9f completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:11:35.901456 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 357a4df7-5d82-4e9d-b8d1-2190f63e3f9f triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:11:35.901831 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:36.082424 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-31ed8fa4-4901-483f-8a1d-d66780a0acf0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:36.147414 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-31ed8fa4-4901-483f-8a1d-d66780a0acf0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:36.152126 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-31ed8fa4-4901-483f-8a1d-d66780a0acf0 admin admin] Usage tracker for resource:security_group_rule and tenant:56a6d8d13643481cb5e56711dd675a7a is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:36.156045 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-31ed8fa4-4901-483f-8a1d-d66780a0acf0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:36.162813 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-31ed8fa4-4901-483f-8a1d-d66780a0acf0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:36.241183 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] Notify callbacks [] for port, precommit_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:36.254826 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:36.265517 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-31ed8fa4-4901-483f-8a1d-d66780a0acf0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:36.282156 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] Transition to ACTIVE for port object 15dfae58-2fa8-4151-bc0e-796ec182e152 will not be triggered until provisioned by entity L2. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:11:36.297064 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:36.306905 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port 357a4df7-5d82-4e9d-b8d1-2190f63e3f9f, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=357a4df7-5d82-4e9d-b8d1-2190f63e3f9f,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:11:36.307967 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:36.330028 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e4dc252f-b5b8-4347-a729-99d13b70f625 req-95f22691-f031-4d3b-a8e8-af47e6235adc tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 210 time: 1.0044937
Jun 01 06:11:36.331174 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-31ed8fa4-4901-483f-8a1d-d66780a0acf0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:36.381858 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:36.436687 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] Attempting to bind port 15dfae58-2fa8-4151-bc0e-796ec182e152 on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:11:36.437316 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] Attempting to bind port 15dfae58-2fa8-4151-bc0e-796ec182e152 by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:11:36.437874 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] Attempting to bind port 15dfae58-2fa8-4151-bc0e-796ec182e152 on network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:11:36.446990 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 11, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:11:36.447393 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] Checking segment: {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92231) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:11:36.447824 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:36.448215 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] Bound using segment: {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:11:36.448757 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] Bound port: 15dfae58-2fa8-4151-bc0e-796ec182e152, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:11:36.449372 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:36.630368 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] For port 15dfae58-2fa8-4151-bc0e-796ec182e152, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92231) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:11:36.646121 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] For port 15dfae58-2fa8-4151-bc0e-796ec182e152, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=15dfae58-2fa8-4151-bc0e-796ec182e152,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92231) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:11:36.667817 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb5444a0-5b14-4a1d-95d6-ab442a6eedee None None] Pushing event updated for resources: {'Port': ['ID=15dfae58-2fa8-4151-bc0e-796ec182e152,revision_number=2']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:36.675680 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:36.676832 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-bb5444a0-5b14-4a1d-95d6-ab442a6eedee None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.369s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:36.677389 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.255s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:36.725667 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 59282) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:36.731700 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-6806bea2-9071-4c7e-b736-f3d3ad55edc8 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1918997533', 'description': 'tempest-description--1623988429'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:36.754767 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-6806bea2-9071-4c7e-b736-f3d3ad55edc8 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:36.768741 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-6806bea2-9071-4c7e-b736-f3d3ad55edc8 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Usage tracker for resource:security_group and tenant:ac4006667c3442a3910d548e9e9d22c0 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:36.780326 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-6806bea2-9071-4c7e-b736-f3d3ad55edc8 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:36.795051 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-6806bea2-9071-4c7e-b736-f3d3ad55edc8 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:36.808120 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] Routers {'b7bdc21e-592c-4bbf-87c9-5eba5676579e'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:11:36.810148 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b210f1c0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:11:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:11:36.814076 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-6806bea2-9071-4c7e-b736-f3d3ad55edc8 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:36.842243 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-6806bea2-9071-4c7e-b736-f3d3ad55edc8 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:36.847484 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-6806bea2-9071-4c7e-b736-f3d3ad55edc8 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Usage tracker for resource:security_group_rule and tenant:ac4006667c3442a3910d548e9e9d22c0 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:36.851755 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-6806bea2-9071-4c7e-b736-f3d3ad55edc8 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:36.863074 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-6806bea2-9071-4c7e-b736-f3d3ad55edc8 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:36.957378 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=357a4df7-5d82-4e9d-b8d1-2190f63e3f9f,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:36.977491 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-907ebe46-b106-4923-9880-06ca8cd4a7ec tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:36.983259 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-d6ab5e8e-7689-4bc5-ad2b-b8daa9984dc5 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=92230) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 06:11:36.987644 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-907ebe46-b106-4923-9880-06ca8cd4a7ec tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Usage tracker for resource:port and tenant:b02068c8f29e4f5e9b3c965d023f7e29 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:36.988598 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-d6ab5e8e-7689-4bc5-ad2b-b8daa9984dc5 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.48 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0187056
Jun 01 06:11:36.997751 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-907ebe46-b106-4923-9880-06ca8cd4a7ec tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:37.015511 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-907ebe46-b106-4923-9880-06ca8cd4a7ec tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:37.046674 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:37.062414 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-6806bea2-9071-4c7e-b736-f3d3ad55edc8 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:37.073132 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-6806bea2-9071-4c7e-b736-f3d3ad55edc8 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:37.126131 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:37.205357 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6806bea2-9071-4c7e-b736-f3d3ad55edc8 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Pushing event updated for resources: {'SecurityGroup': ['ID=932cfb13-85ed-405d-8a3d-cd7d8f3bab94,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:37.218562 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-6806bea2-9071-4c7e-b736-f3d3ad55edc8 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:37.225574 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-6806bea2-9071-4c7e-b736-f3d3ad55edc8 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1778 time: 0.4987242
Jun 01 06:11:37.227706 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-6806bea2-9071-4c7e-b736-f3d3ad55edc8 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:37.229669 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 59290) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:37.235994 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 59294) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:37.244428 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-f88635c8-6a0d-4472-947d-eeb86065f95a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Request body: {'security_group_rule': {'security_group_id': '932cfb13-85ed-405d-8a3d-cd7d8f3bab94', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:37.254599 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] Sync routers for ids ['f8aef563-57d3-45c3-afd4-23442c8f572d'] in dv-cinder-793885-1-iscsi {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:11:37.270137 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-f88635c8-6a0d-4472-947d-eeb86065f95a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:37.271560 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-a5947501-3e95-4541-8e09-28da965daab4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:37.276142 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] Routers {'f8aef563-57d3-45c3-afd4-23442c8f572d'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:11:37.278099 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b240f0d0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:11:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['f8aef563-57d3-45c3-afd4-23442c8f572d'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:11:37.284347 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-f88635c8-6a0d-4472-947d-eeb86065f95a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Usage tracker for resource:security_group_rule and tenant:ac4006667c3442a3910d548e9e9d22c0 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:37.292360 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-f88635c8-6a0d-4472-947d-eeb86065f95a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:37.301227 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 357a4df7-5d82-4e9d-b8d1-2190f63e3f9f up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:11:37.307583 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-a5947501-3e95-4541-8e09-28da965daab4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:37.308781 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-f88635c8-6a0d-4472-947d-eeb86065f95a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:37.360090 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f88635c8-6a0d-4472-947d-eeb86065f95a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:37.461737 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f88635c8-6a0d-4472-947d-eeb86065f95a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:37.502790 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-abedd3e4-2b43-4de1-b218-419e06bb5080 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:37.504253 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-a5947501-3e95-4541-8e09-28da965daab4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:37.526150 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f88635c8-6a0d-4472-947d-eeb86065f95a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:37.532201 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Request body: {'port': {'device_id': 'b662816d-f3d5-434d-b2c3-eb501ac85556', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79388'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:37.546974 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-907ebe46-b106-4923-9880-06ca8cd4a7ec tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Made reservation on behalf of b02068c8f29e4f5e9b3c965d023f7e29 for: {'port': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:11:37.555155 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-907ebe46-b106-4923-9880-06ca8cd4a7ec tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:37.581718 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-abedd3e4-2b43-4de1-b218-419e06bb5080 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:37.593346 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-abedd3e4-2b43-4de1-b218-419e06bb5080 admin admin] Usage tracker for resource:security_group_rule and tenant:08ea9e10cbc64ee6bc0a6b3ba366f043 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:37.598752 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-abedd3e4-2b43-4de1-b218-419e06bb5080 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:37.622795 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb5444a0-5b14-4a1d-95d6-ab442a6eedee None None] Pushing event updated for resources: {'Port': ['ID=15dfae58-2fa8-4151-bc0e-796ec182e152,revision_number=3']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:37.633395 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-abedd3e4-2b43-4de1-b218-419e06bb5080 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:37.633616 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-bb5444a0-5b14-4a1d-95d6-ab442a6eedee None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.956s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:37.637967 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-119605c0-d1b2-4c53-9a4b-393844391656 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.889s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:37.638313 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-119605c0-d1b2-4c53-9a4b-393844391656 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.001s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:37.644086 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] Set router b7bdc21e-592c-4bbf-87c9-5eba5676579e gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:11:37.770931 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:37.772088 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] Set router f8aef563-57d3-45c3-afd4-23442c8f572d gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:11:37.798407 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f88635c8-6a0d-4472-947d-eeb86065f95a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ce2b8169-2f2a-48ca-9895-f3129c633dd8,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:37.821916 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-f88635c8-6a0d-4472-947d-eeb86065f95a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:37.827975 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 357a4df7-5d82-4e9d-b8d1-2190f63e3f9f triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:11:37.828344 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:37.914729 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:37.956999 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f88635c8-6a0d-4472-947d-eeb86065f95a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:37.961582 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-f88635c8-6a0d-4472-947d-eeb86065f95a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.7288396
Jun 01 06:11:37.964562 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 59308) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:37.979162 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-e821896c-41de-4670-9ece-0b9734d7ddb0 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Request body: {'security_group_rule': {'security_group_id': '932cfb13-85ed-405d-8a3d-cd7d8f3bab94', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:37.988582 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e821896c-41de-4670-9ece-0b9734d7ddb0 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:37.993457 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e821896c-41de-4670-9ece-0b9734d7ddb0 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Usage tracker for resource:security_group_rule and tenant:ac4006667c3442a3910d548e9e9d22c0 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:37.997059 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e821896c-41de-4670-9ece-0b9734d7ddb0 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:38.004536 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e821896c-41de-4670-9ece-0b9734d7ddb0 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:38.099369 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-abedd3e4-2b43-4de1-b218-419e06bb5080 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:38.107394 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e821896c-41de-4670-9ece-0b9734d7ddb0 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:38.145413 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-abedd3e4-2b43-4de1-b218-419e06bb5080 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:38.200233 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-31ed8fa4-4901-483f-8a1d-d66780a0acf0 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=56a6d8d13643481cb5e56711dd675a7a&name=default HTTP/1.1" status: 200  len: 2975 time: 3.8220234
Jun 01 06:11:38.218067 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:38.243328 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 59312) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:38.245239 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31ed8fa4-4901-483f-8a1d-d66780a0acf0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ef4ae498-fdc2-4e25-aa4e-011176352bee,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:38.305721 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-a5947501-3e95-4541-8e09-28da965daab4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:38.307011 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-a5947501-3e95-4541-8e09-28da965daab4 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/33a40c0b-b4f0-438c-a114-517aebf947de HTTP/1.1" status: 204  len: 168 time: 2.6322134
Jun 01 06:11:38.317016 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-31ed8fa4-4901-483f-8a1d-d66780a0acf0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.270s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:38.317355 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.203s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:38.377448 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5947501-3e95-4541-8e09-28da965daab4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=33a40c0b-b4f0-438c-a114-517aebf947de,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:38.401227 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d8ab721-7507-488f-bb97-cbaeb530735b req-1133b705-7675-4127-8c1a-2612e6606e4a tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:38.409868 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4d8ab721-7507-488f-bb97-cbaeb530735b req-1133b705-7675-4127-8c1a-2612e6606e4a tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/ports?device_id=b662816d-f3d5-434d-b2c3-eb501ac85556 HTTP/1.1" status: 200  len: 932 time: 1.4763763
Jun 01 06:11:38.411526 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-63e4bb8d-27a2-496d-b802-e9fddfda529e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:38.445429 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-a5947501-3e95-4541-8e09-28da965daab4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:38.459097 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-19186df5-e9c7-4fa9-bfa6-2392672ddef4 req-04c230c2-ad19-4d3d-b2d9-819ff52387af tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 210 time: 0.6895165
Jun 01 06:11:38.481936 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Router ea184dcf-09ad-4302-82aa-16ce19e6c1e5 is scheduled to L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 with binding_index 1 {{(pid=92229) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 06:11:38.511624 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b210f1c0>, [{'id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'name': 'tempest-AttachVolumeShelveTestJSON-921884409-router', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20'}], 'enable_snat': True}, 'gw_port_id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:24Z', 'updated_at': '2021-06-01T06:11:28Z', 'revision_number': 3, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'gw_port': {'id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:b4:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:27Z', 'updated_at': '2021-06-01T06:11:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:11:38.547017 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-badc0fe6-1cbb-485a-9c40-4b3f0e99b722 None None] The sync data for ids ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'] in dv-cinder-793885-1-iscsi is: [{'id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'name': 'tempest-AttachVolumeShelveTestJSON-921884409-router', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20'}], 'enable_snat': True}, 'gw_port_id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:24Z', 'updated_at': '2021-06-01T06:11:28Z', 'revision_number': 3, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'gw_port': {'id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:b4:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:27Z', 'updated_at': '2021-06-01T06:11:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:11:38.680212 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abedd3e4-2b43-4de1-b218-419e06bb5080 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8090cc08-1c08-4e8e-9c75-b973bc922468,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:38.687301 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-abedd3e4-2b43-4de1-b218-419e06bb5080 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.468s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:38.697903 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-abedd3e4-2b43-4de1-b218-419e06bb5080 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=08ea9e10cbc64ee6bc0a6b3ba366f043&name=default HTTP/1.1" status: 200  len: 2975 time: 1.4605217
Jun 01 06:11:38.705757 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 59322) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:38.749771 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-4d8ab721-7507-488f-bb97-cbaeb530735b req-c66eea77-359b-4ecb-9fc4-1ea5cac7b1a0 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Synchronizing usage tracker for tenant:1e84732645d04c3dae887b1b3847cffe on resource:security_group {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:11:38.750672 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b240f0d0>, [{'id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'name': 'tempest-AttachVolumeTestJSON-1575365070-router', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214'}], 'enable_snat': True}, 'gw_port_id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:23Z', 'updated_at': '2021-06-01T06:11:31Z', 'revision_number': 4, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'gw_port': {'id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:02:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '8e48657d-a82c-420f-8462-d947f458adb4', 'name': '', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'mac_address': 'fa:16:3e:9f:72:38', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '3e980239-de35-45a0-8039-8395b5408617', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:30Z', 'updated_at': '2021-06-01T06:11:31Z', 'revision_number': 2, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'subnets': [{'id': '3e980239-de35-45a0-8039-8395b5408617', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:11:38.756549 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] Checking router: f8aef563-57d3-45c3-afd4-23442c8f572d for host: dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:11:38.757540 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] Updating router f8aef563-57d3-45c3-afd4-23442c8f572d port 8e48657d-a82c-420f-8462-d947f458adb4 binding host dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 06:11:38.937837 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:38.963165 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-10cc5533-df8f-47ef-86c6-3e2a1a455704 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:39.001937 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-4d8ab721-7507-488f-bb97-cbaeb530735b req-c66eea77-359b-4ecb-9fc4-1ea5cac7b1a0 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Unset dirty status for tenant:1e84732645d04c3dae887b1b3847cffe on resource:security_group {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:11:39.009821 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4d8ab721-7507-488f-bb97-cbaeb530735b req-c66eea77-359b-4ecb-9fc4-1ea5cac7b1a0 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/security-groups?id=322d6e24-5243-409c-8b80-acbe06176a3c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.5989814
Jun 01 06:11:39.534226 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.notifiers.nova [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id dad38687-d35c-4b39-9dd6-26cb8f3ec5a7 {{(pid=92230) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:11:39.534226 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Notify callbacks [] for port, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:39.534226 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.provisioning_blocks [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Transition to ACTIVE for port object dad38687-d35c-4b39-9dd6-26cb8f3ec5a7 will not be triggered until provisioned by entity L2. {{(pid=92230) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:11:39.534226 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:39.534226 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-ac2363b0-b056-4cab-b5ba-74e62a59635f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:39.545854 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-907ebe46-b106-4923-9880-06ca8cd4a7ec tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Allocated IP 172.20.0.4 (8c37e9ed-7031-4d7f-bfd1-3763eabba1b6/52a5c0c8-e902-4e55-bfa8-495f043331da/de8f02a4-b74f-47df-a797-bc3cbe7be366) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:11:39.635604 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92229) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:11:39.659103 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] Sync routers for ids ['ea184dcf-09ad-4302-82aa-16ce19e6c1e5'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:11:39.697265 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] Routers {'ea184dcf-09ad-4302-82aa-16ce19e6c1e5'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:11:39.698297 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b26c2be0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:11:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['ea184dcf-09ad-4302-82aa-16ce19e6c1e5'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:11:39.885124 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ce82a092-c10f-4ae3-9390-cf51ff021e34 req-73475511-5e50-4bd8-8109-ed4878d8cae1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 210 time: 0.1308026
Jun 01 06:11:39.954667 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [None req-10cc5533-df8f-47ef-86c6-3e2a1a455704 admin admin] Allocated IP 172.20.0.1 (5f973ed4-521b-4b78-9a54-1336b1302fa2/6137ee10-ce13-45c9-8edb-31811502bfd7/47f62b29-867e-4af1-9330-02c97cb95473) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:11:39.971980 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Notify callbacks [] for router, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:39.986157 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201  len: 930 time: 14.8782008
Jun 01 06:11:39.987037 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 59346) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:40.034390 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] Notify callbacks [] for port, precommit_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:40.107574 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.provisioning_blocks [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] Transition to ACTIVE for port object 8e48657d-a82c-420f-8462-d947f458adb4 will not be triggered until provisioned by entity L2. {{(pid=92232) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:11:40.125846 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:40.135513 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-28c041af-f2bc-4f42-847f-46efbfd31274 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:40.297225 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-379e0958-258b-42b6-832c-138aeae1028e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:40.306663 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] Set router ea184dcf-09ad-4302-82aa-16ce19e6c1e5 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:11:40.432241 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3da4fd4-af3b-46af-828a-54d799fc9880 None None] Pushing event updated for resources: {'Port': ['ID=8e48657d-a82c-420f-8462-d947f458adb4,revision_number=3']} {{(pid=92232) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:40.461992 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-e3da4fd4-af3b-46af-828a-54d799fc9880 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.328s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:40.598443 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Pushing event updated for resources: {'Port': ['ID=dad38687-d35c-4b39-9dd6-26cb8f3ec5a7,revision_number=2']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:40.608704 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.161s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:40.728654 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e821896c-41de-4670-9ece-0b9734d7ddb0 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:40.825692 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.managers [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Attempting to bind port dad38687-d35c-4b39-9dd6-26cb8f3ec5a7 on host hv-cinder-79388 for vnic_type normal with profile  {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:11:40.826316 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.managers [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Attempting to bind port dad38687-d35c-4b39-9dd6-26cb8f3ec5a7 by drivers openvswitch,hyperv on host hv-cinder-79388 at level 0 using segments [{'id': '2ae86fef-efbf-4f06-98a8-03571bcdb7ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 233, 'network_id': 'a3095bbd-0ae1-463e-b1b5-d29b58112d63'}] {{(pid=92230) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:11:40.826850 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Attempting to bind port dad38687-d35c-4b39-9dd6-26cb8f3ec5a7 on network a3095bbd-0ae1-463e-b1b5-d29b58112d63 {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:11:40.854566 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e821896c-41de-4670-9ece-0b9734d7ddb0 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:40.859493 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-379e0958-258b-42b6-832c-138aeae1028e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:40.948539 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:41.000861 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e821896c-41de-4670-9ece-0b9734d7ddb0 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=114f3b8e-c869-43a4-953f-6e3d0258bfc9,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:41.006315 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e821896c-41de-4670-9ece-0b9734d7ddb0 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:41.006913 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f45aa393-03d9-430b-bfef-e447ed5cc6b6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:41.035188 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] Attempting to bind port 8e48657d-a82c-420f-8462-d947f458adb4 on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:11:41.045781 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] Attempting to bind port 8e48657d-a82c-420f-8462-d947f458adb4 by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': '5dda6d07-db2a-40a3-815e-42df1528c630', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 224, 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7'}] {{(pid=92232) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:11:41.046580 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] Attempting to bind port 8e48657d-a82c-420f-8462-d947f458adb4 on network 0890ab9c-2266-4ef4-af73-d3ff421b9bd7 {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:11:41.064972 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 11, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:11:41.065666 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] Checking segment: {'id': '5dda6d07-db2a-40a3-815e-42df1528c630', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 224, 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92232) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:11:41.066241 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:41.066795 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] Bound using segment: {'id': '5dda6d07-db2a-40a3-815e-42df1528c630', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 224, 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7'} {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:11:41.067515 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] Bound port: 8e48657d-a82c-420f-8462-d947f458adb4, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5dda6d07-db2a-40a3-815e-42df1528c630', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 224, 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7'}}] {{(pid=92232) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:11:41.068223 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:41.092405 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f45aa393-03d9-430b-bfef-e447ed5cc6b6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:41.215057 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Port dad38687-d35c-4b39-9dd6-26cb8f3ec5a7 on network a3095bbd-0ae1-463e-b1b5-d29b58112d63 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79388 {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 06:11:41.222966 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Attempting to bind port dad38687-d35c-4b39-9dd6-26cb8f3ec5a7 on network a3095bbd-0ae1-463e-b1b5-d29b58112d63 {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:11:41.229420 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e821896c-41de-4670-9ece-0b9734d7ddb0 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:41.230842 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-e821896c-41de-4670-9ece-0b9734d7ddb0 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 3.2641826
Jun 01 06:11:41.248224 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 59360) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:41.281703 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b26c2be0>, [{'id': 'ea184dcf-09ad-4302-82aa-16ce19e6c1e5', 'name': 'tempest-ServerRescueNegativeTestJSON-979777158-router', 'tenant_id': '8f1cf739e243401eb5da7ee705e856de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.222'}], 'enable_snat': True}, 'gw_port_id': 'e157eec0-3394-4fbf-8701-c05f500f506a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:31Z', 'revision_number': 3, 'project_id': '8f1cf739e243401eb5da7ee705e856de', 'gw_port': {'id': 'e157eec0-3394-4fbf-8701-c05f500f506a', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:84:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea184dcf-09ad-4302-82aa-16ce19e6c1e5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.222', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:29Z', 'updated_at': '2021-06-01T06:11:29Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:11:41.289610 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] Checking router: ea184dcf-09ad-4302-82aa-16ce19e6c1e5 for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:11:41.289610 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] Updating router ea184dcf-09ad-4302-82aa-16ce19e6c1e5 port e157eec0-3394-4fbf-8701-c05f500f506a binding host dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 06:11:41.344760 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Checking agent: {'id': '56148394-2131-4d06-bcfa-c032301591b8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79388', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'started_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 11, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:11:41.348289 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Checking segment: {'id': '2ae86fef-efbf-4f06-98a8-03571bcdb7ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 233, 'network_id': 'a3095bbd-0ae1-463e-b1b5-d29b58112d63'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92230) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:11:41.350958 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Bound using segment: {'id': '2ae86fef-efbf-4f06-98a8-03571bcdb7ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 233, 'network_id': 'a3095bbd-0ae1-463e-b1b5-d29b58112d63'} {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:11:41.351565 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.managers [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Bound port: dad38687-d35c-4b39-9dd6-26cb8f3ec5a7, host: hv-cinder-79388, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2ae86fef-efbf-4f06-98a8-03571bcdb7ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 233, 'network_id': 'a3095bbd-0ae1-463e-b1b5-d29b58112d63'}}] {{(pid=92230) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:11:41.352110 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:41.475334 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.db [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] For port 8e48657d-a82c-420f-8462-d947f458adb4, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92232) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:11:41.488047 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.db [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] For port 8e48657d-a82c-420f-8462-d947f458adb4, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=8e48657d-a82c-420f-8462-d947f458adb4,segment=NetworkSegment(5dda6d07-db2a-40a3-815e-42df1528c630),segment_id=5dda6d07-db2a-40a3-815e-42df1528c630)] {{(pid=92232) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:11:41.497356 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:41.508609 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:41.510029 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:41.586846 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Request body: {'floatingip': {'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:41.599872 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:41.607886 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Usage tracker for resource:floatingip and tenant:ac4006667c3442a3910d548e9e9d22c0 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:41.610694 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f45aa393-03d9-430b-bfef-e447ed5cc6b6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:41.621235 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-379e0958-258b-42b6-832c-138aeae1028e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:41.623048 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:41.630403 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:41.634591 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:41.698302 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f45aa393-03d9-430b-bfef-e447ed5cc6b6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ef4ae498-fdc2-4e25-aa4e-011176352bee,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:41.720991 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for floatingip, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:41.751245 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] Routers {'f8aef563-57d3-45c3-afd4-23442c8f572d'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:11:41.751993 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b240f0d0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:11:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['f8aef563-57d3-45c3-afd4-23442c8f572d'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:11:41.759681 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-379e0958-258b-42b6-832c-138aeae1028e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8090cc08-1c08-4e8e-9c75-b973bc922468,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:41.799773 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-379e0958-258b-42b6-832c-138aeae1028e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:41.856200 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] For port dad38687-d35c-4b39-9dd6-26cb8f3ec5a7, host hv-cinder-79388, cleared binding levels {{(pid=92230) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:11:41.865728 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] For port dad38687-d35c-4b39-9dd6-26cb8f3ec5a7, host hv-cinder-79388, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=dad38687-d35c-4b39-9dd6-26cb8f3ec5a7,segment=NetworkSegment(2ae86fef-efbf-4f06-98a8-03571bcdb7ca),segment_id=2ae86fef-efbf-4f06-98a8-03571bcdb7ca)] {{(pid=92230) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:11:41.868805 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.115s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:41.869876 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.001s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:41.873016 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3da4fd4-af3b-46af-828a-54d799fc9880 None None] Pushing event updated for resources: {'Port': ['ID=8e48657d-a82c-420f-8462-d947f458adb4,revision_number=4']} {{(pid=92232) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:41.878960 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-e3da4fd4-af3b-46af-828a-54d799fc9880 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.370s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:41.903682 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-379e0958-258b-42b6-832c-138aeae1028e admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:41.909822 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-379e0958-258b-42b6-832c-138aeae1028e admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/8090cc08-1c08-4e8e-9c75-b973bc922468 HTTP/1.1" status: 204  len: 168 time: 3.2023995
Jun 01 06:11:41.912014 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f45aa393-03d9-430b-bfef-e447ed5cc6b6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:41.913597 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-f45aa393-03d9-430b-bfef-e447ed5cc6b6 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/ef4ae498-fdc2-4e25-aa4e-011176352bee HTTP/1.1" status: 204  len: 168 time: 3.4994712
Jun 01 06:11:41.927462 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:41.940705 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:42.078041 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] Set router f8aef563-57d3-45c3-afd4-23442c8f572d gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:11:42.273034 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-10cc5533-df8f-47ef-86c6-3e2a1a455704 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:42.295177 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [None req-10cc5533-df8f-47ef-86c6-3e2a1a455704 admin admin] Transition to ACTIVE for port object 47f62b29-867e-4af1-9330-02c97cb95473 will not be triggered until provisioned by entity DHCP. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:11:42.323181 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:42.325357 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for port, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:42.354784 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] 10.222.0.48 "PUT /v2.0/ports/dad38687-d35c-4b39-9dd6-26cb8f3ec5a7 HTTP/1.1" status: 200  len: 1094 time: 5.0175307
Jun 01 06:11:42.400754 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Pushing event updated for resources: {'Port': ['ID=dad38687-d35c-4b39-9dd6-26cb8f3ec5a7,revision_number=3']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:42.412631 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-907ebe46-b106-4923-9880-06ca8cd4a7ec tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:42.415737 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.474s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:42.423371 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b662816d-f3d5-434d-b2c3-eb501ac85556', 'tag': 'dad38687-d35c-4b39-9dd6-26cb8f3ec5a7'}] {{(pid=92230) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:11:42.475138 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-e84ae6d4-ea61-4676-abff-3792c8119822 req-e2fa708a-d1f6-4223-872b-cbffaea7a0ac tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Synchronizing usage tracker for tenant:b02068c8f29e4f5e9b3c965d023f7e29 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:11:42.520426 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-907ebe46-b106-4923-9880-06ca8cd4a7ec tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:42.522315 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-10cc5533-df8f-47ef-86c6-3e2a1a455704 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:42.524019 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:42.531939 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 15dfae58-2fa8-4151-bc0e-796ec182e152 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:11:42.783661 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:42.826712 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-c5ef54d6-177e-469d-9fc5-288de44b71b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:42.946834 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-7bc021e1-44cd-48d7-935c-a1a716eaa13f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:42.950270 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-7bc021e1-44cd-48d7-935c-a1a716eaa13f service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=1e84732645d04c3dae887b1b3847cffe&device_id=b662816d-f3d5-434d-b2c3-eb501ac85556 HTTP/1.1" status: 200  len: 1097 time: 0.2507184
Jun 01 06:11:42.999122 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port 15dfae58-2fa8-4151-bc0e-796ec182e152 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:11:43.023475 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b240f0d0>, [{'id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'name': 'tempest-AttachVolumeTestJSON-1575365070-router', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214'}], 'enable_snat': True}, 'gw_port_id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:23Z', 'updated_at': '2021-06-01T06:11:31Z', 'revision_number': 4, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'gw_port': {'id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:02:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '8e48657d-a82c-420f-8462-d947f458adb4', 'name': '', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'mac_address': 'fa:16:3e:9f:72:38', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '3e980239-de35-45a0-8039-8395b5408617', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:30Z', 'updated_at': '2021-06-01T06:11:41Z', 'revision_number': 4, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'subnets': [{'id': '3e980239-de35-45a0-8039-8395b5408617', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:11:43.035827 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-beaea80e-a392-4770-998b-b4fc733fb888 None None] The sync data for ids ['f8aef563-57d3-45c3-afd4-23442c8f572d'] in dv-cinder-793885-1-iscsi is: [{'id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'name': 'tempest-AttachVolumeTestJSON-1575365070-router', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214'}], 'enable_snat': True}, 'gw_port_id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:23Z', 'updated_at': '2021-06-01T06:11:31Z', 'revision_number': 4, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'gw_port': {'id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:02:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '8e48657d-a82c-420f-8462-d947f458adb4', 'name': '', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'mac_address': 'fa:16:3e:9f:72:38', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '3e980239-de35-45a0-8039-8395b5408617', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:30Z', 'updated_at': '2021-06-01T06:11:41Z', 'revision_number': 4, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'subnets': [{'id': '3e980239-de35-45a0-8039-8395b5408617', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:11:43.056905 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 15dfae58-2fa8-4151-bc0e-796ec182e152 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:11:43.058499 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:43.145451 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-cadd8ed4-87de-45e7-9cb1-d9e0c8c410c5 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=dad38687-d35c-4b39-9dd6-26cb8f3ec5a7 HTTP/1.1" status: 200  len: 217 time: 0.1579947
Jun 01 06:11:43.193331 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10cc5533-df8f-47ef-86c6-3e2a1a455704 admin admin] Network 5f973ed4-521b-4b78-9a54-1336b1302fa2 is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:11:43.205653 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10cc5533-df8f-47ef-86c6-3e2a1a455704 admin admin] Pushing event updated for resources: {'Port': ['ID=47f62b29-867e-4af1-9330-02c97cb95473,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:43.208566 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-10cc5533-df8f-47ef-86c6-3e2a1a455704 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:11:43.210222 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-e84ae6d4-ea61-4676-abff-3792c8119822 req-e2fa708a-d1f6-4223-872b-cbffaea7a0ac tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Unset dirty status for tenant:b02068c8f29e4f5e9b3c965d023f7e29 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:11:43.212018 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e84ae6d4-ea61-4676-abff-3792c8119822 req-e2fa708a-d1f6-4223-872b-cbffaea7a0ac tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 210 time: 1.9383595
Jun 01 06:11:43.213783 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10cc5533-df8f-47ef-86c6-3e2a1a455704 admin admin] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:11:43.214251 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-10cc5533-df8f-47ef-86c6-3e2a1a455704 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-744049'] for router_interface, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:43.283426 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 59386) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:43.381494 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a8971187fdc179bafebfda031591b22633150c3ea1d9449252a7819502f19756" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-189f6e94-1717-4ff9-b8f3-6a0de86a10b1" -d '{"events": [{"name": "network-changed", "server_uuid": "b662816d-f3d5-434d-b2c3-eb501ac85556", "tag": "dad38687-d35c-4b39-9dd6-26cb8f3ec5a7"}]}' {{(pid=92230) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:11:43.410618 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-93b3d8a8-9c81-4a00-9c01-36780b2f2904 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:43.458247 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] Notify callbacks [] for port, precommit_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:43.468572 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-93b3d8a8-9c81-4a00-9c01-36780b2f2904 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:43.478181 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-93b3d8a8-9c81-4a00-9c01-36780b2f2904 admin admin] Usage tracker for resource:security_group_rule and tenant:9eafeed9f0d240f0ba488d1781bb1579 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:43.484276 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] Transition to ACTIVE for port object e157eec0-3394-4fbf-8701-c05f500f506a will not be triggered until provisioned by entity L2. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:11:43.487992 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-93b3d8a8-9c81-4a00-9c01-36780b2f2904 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:43.513262 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-93b3d8a8-9c81-4a00-9c01-36780b2f2904 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:43.552962 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:43.570304 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-99d5e11f-c56c-41f3-a6b2-a9d8514a69e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:43.571987 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-99d5e11f-c56c-41f3-a6b2-a9d8514a69e7 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=5d7e3531-6a32-40da-9550-2584d9bd4210 HTTP/1.1" status: 200  len: 852 time: 0.4040551
Jun 01 06:11:43.576044 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-907ebe46-b106-4923-9880-06ca8cd4a7ec tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Network 8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:11:43.626068 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:43.644773 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-907ebe46-b106-4923-9880-06ca8cd4a7ec tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:11:43.656440 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-907ebe46-b106-4923-9880-06ca8cd4a7ec tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:11:43.669617 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-907ebe46-b106-4923-9880-06ca8cd4a7ec tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:43.674248 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-907ebe46-b106-4923-9880-06ca8cd4a7ec tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:43.736670 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-3660d26a-8541-4328-ab9f-f26ab626a54f service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=a3095bbd-0ae1-463e-b1b5-d29b58112d63&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1424448
Jun 01 06:11:43.786698 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-907ebe46-b106-4923-9880-06ca8cd4a7ec tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 9.7599959
Jun 01 06:11:43.794554 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] Attempting to bind port e157eec0-3394-4fbf-8701-c05f500f506a on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:11:43.795985 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] Attempting to bind port e157eec0-3394-4fbf-8701-c05f500f506a by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:11:43.796623 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] Attempting to bind port e157eec0-3394-4fbf-8701-c05f500f506a on network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:11:43.801924 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f318493e-63e3-496e-b4a7-301e734e8e3f None None] Pushing event updated for resources: {'Port': ['ID=e157eec0-3394-4fbf-8701-c05f500f506a,revision_number=2']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:43.824102 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:43.831836 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-f318493e-63e3-496e-b4a7-301e734e8e3f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.205s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:43.845300 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 11, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:11:43.847574 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] Checking segment: {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92231) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:11:43.848543 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:43.867491 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] Bound using segment: {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:11:43.870494 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] Bound port: e157eec0-3394-4fbf-8701-c05f500f506a, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:11:43.875872 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:43.924780 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:11:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7524d8ec-f2ad-42fa-ac1f-410530b8684d x-openstack-request-id: req-7524d8ec-f2ad-42fa-ac1f-410530b8684d {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:11:43.931951 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b662816d-f3d5-434d-b2c3-eb501ac85556", "tag": "dad38687-d35c-4b39-9dd6-26cb8f3ec5a7", "status": "completed", "code": 200}]} {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:11:43.932267 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-7524d8ec-f2ad-42fa-ac1f-410530b8684d {{(pid=92230) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:11:43.934448 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b662816d-f3d5-434d-b2c3-eb501ac85556', 'tag': 'dad38687-d35c-4b39-9dd6-26cb8f3ec5a7', 'status': 'completed', 'code': 200}
Jun 01 06:11:44.087311 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-907ebe46-b106-4923-9880-06ca8cd4a7ec tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Pushing event updated for resources: {'Port': ['ID=de8f02a4-b74f-47df-a797-bc3cbe7be366,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:44.124401 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c83d29e-3f5f-46c4-a6e6-c1b70cec9ea5 req-ab762b4c-c401-414e-a945-ed05a8bf501d tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:44.128071 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7c83d29e-3f5f-46c4-a6e6-c1b70cec9ea5 req-ab762b4c-c401-414e-a945-ed05a8bf501d tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/ports?device_id=b662816d-f3d5-434d-b2c3-eb501ac85556 HTTP/1.1" status: 200  len: 944 time: 3.4684799
Jun 01 06:11:44.153179 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-93b3d8a8-9c81-4a00-9c01-36780b2f2904 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:44.165911 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-93b3d8a8-9c81-4a00-9c01-36780b2f2904 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:44.183604 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] For port e157eec0-3394-4fbf-8701-c05f500f506a, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92231) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:11:44.190255 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] For port e157eec0-3394-4fbf-8701-c05f500f506a, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=e157eec0-3394-4fbf-8701-c05f500f506a,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92231) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:11:44.194912 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-19008654-ae50-488f-9dfc-257e20cb3afb None None] Provisioning for port 47f62b29-867e-4af1-9330-02c97cb95473 completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:11:44.202641 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-19008654-ae50-488f-9dfc-257e20cb3afb None None] Provisioning complete for port 47f62b29-867e-4af1-9330-02c97cb95473 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:11:44.204745 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-19008654-ae50-488f-9dfc-257e20cb3afb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:44.207099 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-abedd3e4-2b43-4de1-b218-419e06bb5080 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:44.216575 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Request body: {'port': {'device_id': '5967d75f-2870-4a80-98ec-b2547cff266e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79388'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:44.270322 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-907ebe46-b106-4923-9880-06ca8cd4a7ec tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.485s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:44.289975 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:44.324528 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-522abf26-c1b0-4cbe-8e09-e7e09f9fc085 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:44.385163 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.845s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:44.385680 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.001s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:44.397954 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93b3d8a8-9c81-4a00-9c01-36780b2f2904 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=31c5e0a2-c4dd-45f5-8095-bd65cdd6b013,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:44.408766 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-93e0557e-7e0e-4cb5-ac9b-2d18b6008ba3 service neutron] 10.222.0.48 "GET /v2.0/networks/a3095bbd-0ae1-463e-b1b5-d29b58112d63?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.6441605
Jun 01 06:11:44.419494 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-93b3d8a8-9c81-4a00-9c01-36780b2f2904 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=9eafeed9f0d240f0ba488d1781bb1579&name=default HTTP/1.1" status: 200  len: 2979 time: 1.1231875
Jun 01 06:11:44.419494 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-93b3d8a8-9c81-4a00-9c01-36780b2f2904 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:44.436897 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 59414) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:44.741940 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-f4c570e3-9ce3-4455-966c-c7c8cb16f5b3 req-714c03c4-857e-4f99-b8c2-0e416b643ca2 service neutron] 10.222.0.48 "GET /v2.0/networks/a3095bbd-0ae1-463e-b1b5-d29b58112d63?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3266389
Jun 01 06:11:44.805685 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-19008654-ae50-488f-9dfc-257e20cb3afb None None] Port 47f62b29-867e-4af1-9330-02c97cb95473 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:11:44.916407 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] Routers {'ea184dcf-09ad-4302-82aa-16ce19e6c1e5'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:11:44.917191 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b26c2be0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:11:43Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['ea184dcf-09ad-4302-82aa-16ce19e6c1e5'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:11:45.182730 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] Set router ea184dcf-09ad-4302-82aa-16ce19e6c1e5 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:11:45.381982 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f318493e-63e3-496e-b4a7-301e734e8e3f None None] Pushing event updated for resources: {'Port': ['ID=e157eec0-3394-4fbf-8701-c05f500f506a,revision_number=3']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:45.417730 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-f318493e-63e3-496e-b4a7-301e734e8e3f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.094s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:45.483826 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-189f6e94-1717-4ff9-b8f3-6a0de86a10b1 req-9782753f-33d2-4503-8d93-e7f7be69d85d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:45.492448 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-189f6e94-1717-4ff9-b8f3-6a0de86a10b1 req-9782753f-33d2-4503-8d93-e7f7be69d85d service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=1e84732645d04c3dae887b1b3847cffe&device_id=b662816d-f3d5-434d-b2c3-eb501ac85556 HTTP/1.1" status: 200  len: 1097 time: 0.2465105
Jun 01 06:11:45.635956 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7c83d29e-3f5f-46c4-a6e6-c1b70cec9ea5 req-5c7971b4-7342-4934-8b95-db8490504dd6 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/security-groups?id=322d6e24-5243-409c-8b80-acbe06176a3c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 1.2488718
Jun 01 06:11:45.728522 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:45.758257 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-da274307-3a1d-4ac1-85c8-abc5ecf34364 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:45.767552 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-10cc5533-df8f-47ef-86c6-3e2a1a455704 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:45.816752 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:45.870730 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:45.872205 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:45.897214 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-189f6e94-1717-4ff9-b8f3-6a0de86a10b1 req-f9729772-86f5-45b3-a9a5-24a9ce94d3a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:45.899376 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-189f6e94-1717-4ff9-b8f3-6a0de86a10b1 req-f9729772-86f5-45b3-a9a5-24a9ce94d3a3 service neutron] 10.222.0.48 "GET /v2.0/networks?id=a3095bbd-0ae1-463e-b1b5-d29b58112d63 HTTP/1.1" status: 200  len: 913 time: 0.3838091
Jun 01 06:11:45.908048 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port 15dfae58-2fa8-4151-bc0e-796ec182e152, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=15dfae58-2fa8-4151-bc0e-796ec182e152,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:11:45.914919 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd5ea5d9-cff1-4d78-92fa-05373fdf92fc req-d1a8990d-898b-48ec-8b02-fad75faf5888 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:45.916659 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fd5ea5d9-cff1-4d78-92fa-05373fdf92fc req-d1a8990d-898b-48ec-8b02-fad75faf5888 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 931 time: 0.9685304
Jun 01 06:11:45.932208 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:45.938193 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:46.114432 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b26c2be0>, [{'id': 'ea184dcf-09ad-4302-82aa-16ce19e6c1e5', 'name': 'tempest-ServerRescueNegativeTestJSON-979777158-router', 'tenant_id': '8f1cf739e243401eb5da7ee705e856de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.222'}], 'enable_snat': True}, 'gw_port_id': 'e157eec0-3394-4fbf-8701-c05f500f506a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:31Z', 'revision_number': 3, 'project_id': '8f1cf739e243401eb5da7ee705e856de', 'gw_port': {'id': 'e157eec0-3394-4fbf-8701-c05f500f506a', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:84:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea184dcf-09ad-4302-82aa-16ce19e6c1e5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.222', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:29Z', 'updated_at': '2021-06-01T06:11:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:11:46.122501 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c05090c-f685-4690-9d8b-400b2087e6bd None None] The sync data for ids ['ea184dcf-09ad-4302-82aa-16ce19e6c1e5'] in dv-cinder-793885-1-iscsi is: [{'id': 'ea184dcf-09ad-4302-82aa-16ce19e6c1e5', 'name': 'tempest-ServerRescueNegativeTestJSON-979777158-router', 'tenant_id': '8f1cf739e243401eb5da7ee705e856de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.222'}], 'enable_snat': True}, 'gw_port_id': 'e157eec0-3394-4fbf-8701-c05f500f506a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:31Z', 'revision_number': 3, 'project_id': '8f1cf739e243401eb5da7ee705e856de', 'gw_port': {'id': 'e157eec0-3394-4fbf-8701-c05f500f506a', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:84:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea184dcf-09ad-4302-82aa-16ce19e6c1e5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.222', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:29Z', 'updated_at': '2021-06-01T06:11:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:11:46.128993 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=15dfae58-2fa8-4151-bc0e-796ec182e152,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:46.132354 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.195s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:46.141089 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-189f6e94-1717-4ff9-b8f3-6a0de86a10b1 req-057d500c-def7-4c67-be19-bfd176272a45 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=dad38687-d35c-4b39-9dd6-26cb8f3ec5a7 HTTP/1.1" status: 200  len: 217 time: 0.1706131
Jun 01 06:11:46.170780 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 8e48657d-a82c-420f-8462-d947f458adb4 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:11:46.317899 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port 8e48657d-a82c-420f-8462-d947f458adb4 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:11:46.341932 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 8e48657d-a82c-420f-8462-d947f458adb4 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:11:46.342526 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:46.419148 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-10cc5533-df8f-47ef-86c6-3e2a1a455704 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:46.428784 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-da274307-3a1d-4ac1-85c8-abc5ecf34364 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:46.439318 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:46.563109 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-189f6e94-1717-4ff9-b8f3-6a0de86a10b1 req-20cb0a62-1305-4799-bb7b-f028b4fe7dfc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:46.564671 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-189f6e94-1717-4ff9-b8f3-6a0de86a10b1 req-20cb0a62-1305-4799-bb7b-f028b4fe7dfc service neutron] 10.222.0.48 "GET /v2.0/subnets?id=5d7e3531-6a32-40da-9550-2584d9bd4210 HTTP/1.1" status: 200  len: 852 time: 0.3159776
Jun 01 06:11:46.628577 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-10cc5533-df8f-47ef-86c6-3e2a1a455704 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:46.633887 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ce554e3c-28b0-4dd7-b4a3-1e41fd5f3855 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:46.698512 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:46.766807 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port 8e48657d-a82c-420f-8462-d947f458adb4, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=8e48657d-a82c-420f-8462-d947f458adb4,segment=NetworkSegment(5dda6d07-db2a-40a3-815e-42df1528c630),segment_id=5dda6d07-db2a-40a3-815e-42df1528c630)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:11:46.777106 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:46.779708 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-bb5444a0-5b14-4a1d-95d6-ab442a6eedee None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:46.961508 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=8e48657d-a82c-420f-8462-d947f458adb4,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:46.966613 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:47.048285 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-189f6e94-1717-4ff9-b8f3-6a0de86a10b1 req-b4400b8b-4e6d-48ab-a289-282cd12dc80f service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=a3095bbd-0ae1-463e-b1b5-d29b58112d63&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1154943
Jun 01 06:11:47.189734 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-10cc5533-df8f-47ef-86c6-3e2a1a455704 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-582666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-744156'] for router_interface, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:47.199130 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:47.418238 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fd5ea5d9-cff1-4d78-92fa-05373fdf92fc req-1ad49d42-6d84-4487-ab0a-ee094dff300b tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 1.1994669
Jun 01 06:11:47.704929 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-da274307-3a1d-4ac1-85c8-abc5ecf34364 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:47.752080 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10cc5533-df8f-47ef-86c6-3e2a1a455704 admin admin] Pushing event updated for resources: {'Port': ['ID=47f62b29-867e-4af1-9330-02c97cb95473,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:47.759405 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-10cc5533-df8f-47ef-86c6-3e2a1a455704 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.557s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:47.849896 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-31ed8fa4-4901-483f-8a1d-d66780a0acf0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:47.925221 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 59470) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:47.932144 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da274307-3a1d-4ac1-85c8-abc5ecf34364 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=31c5e0a2-c4dd-45f5-8095-bd65cdd6b013,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:47.994298 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-189f6e94-1717-4ff9-b8f3-6a0de86a10b1 req-920e2093-d886-4988-8026-dd0d624d76aa service neutron] 10.222.0.48 "GET /v2.0/networks/a3095bbd-0ae1-463e-b1b5-d29b58112d63?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1589210
Jun 01 06:11:48.041169 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-da274307-3a1d-4ac1-85c8-abc5ecf34364 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.191s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:48.053387 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-da274307-3a1d-4ac1-85c8-abc5ecf34364 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:48.054734 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-da274307-3a1d-4ac1-85c8-abc5ecf34364 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/31c5e0a2-c4dd-45f5-8095-bd65cdd6b013 HTTP/1.1" status: 204  len: 168 time: 3.6165540
Jun 01 06:11:48.135900 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3373fd4-b708-4293-b740-eb16c84b58ee req-7350c22f-be01-418d-86b4-804eb04bd2be tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:48.149400 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c3373fd4-b708-4293-b740-eb16c84b58ee req-7350c22f-be01-418d-86b4-804eb04bd2be tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/ports?device_id=b662816d-f3d5-434d-b2c3-eb501ac85556 HTTP/1.1" status: 200  len: 944 time: 0.9634688
Jun 01 06:11:48.209615 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 15dfae58-2fa8-4151-bc0e-796ec182e152 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:11:48.220567 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.db.resource_extend [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] It took 0.15 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
Jun 01 06:11:48.245824 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10cc5533-df8f-47ef-86c6-3e2a1a455704 admin admin] Network 5f973ed4-521b-4b78-9a54-1336b1302fa2 is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:11:48.250566 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Allocated IP 172.27.2.87 (83b812fb-2cfc-46e4-baa4-745218ea3ed2/a59d7d11-a92c-4b4f-83cf-2095ecee2b51/7a40d370-1281-480c-bb6e-357e54ee6080) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:11:48.258277 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-10cc5533-df8f-47ef-86c6-3e2a1a455704 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:11:48.272885 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-03af1ba4-afeb-4eb4-bb35-132bdc4a0df6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:48.340940 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [None req-ce554e3c-28b0-4dd7-b4a3-1e41fd5f3855 admin admin] Allocated IP 172.20.0.1 (6e45a0e5-f930-4b18-8f4f-1693815eb31a/84c296fc-69c0-46e2-b1ed-e3edf435b759/5a0fb2e6-0298-4b76-b4ad-e89873a54e08) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:11:48.351495 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-03af1ba4-afeb-4eb4-bb35-132bdc4a0df6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:48.377134 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-03af1ba4-afeb-4eb4-bb35-132bdc4a0df6 admin admin] Usage tracker for resource:security_group_rule and tenant:44d2444715074c68bcf2f2fba3fccc2e is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:48.381682 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-03af1ba4-afeb-4eb4-bb35-132bdc4a0df6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:48.401602 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-03af1ba4-afeb-4eb4-bb35-132bdc4a0df6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:48.490537 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 15dfae58-2fa8-4151-bc0e-796ec182e152 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:11:48.492475 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:48.512633 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-189f6e94-1717-4ff9-b8f3-6a0de86a10b1 req-5bfbaa22-eb2b-4ab5-9f8b-57e544f8e004 service neutron] 10.222.0.48 "GET /v2.0/networks/a3095bbd-0ae1-463e-b1b5-d29b58112d63?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4957261
Jun 01 06:11:48.754232 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-03af1ba4-afeb-4eb4-bb35-132bdc4a0df6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:48.767208 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-03af1ba4-afeb-4eb4-bb35-132bdc4a0df6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:48.767926 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 8e48657d-a82c-420f-8462-d947f458adb4 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:11:48.773164 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c3373fd4-b708-4293-b740-eb16c84b58ee req-6232a0f8-8f21-4256-a7da-5b8d8937b82f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/security-groups?id=322d6e24-5243-409c-8b80-acbe06176a3c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.6227667
Jun 01 06:11:48.780080 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-93b3d8a8-9c81-4a00-9c01-36780b2f2904 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:48.832709 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-03af1ba4-afeb-4eb4-bb35-132bdc4a0df6 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=44d2444715074c68bcf2f2fba3fccc2e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9063981
Jun 01 06:11:48.833468 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 59492) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:48.838232 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03af1ba4-afeb-4eb4-bb35-132bdc4a0df6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=89baa747-ab1a-46f3-96c0-f41f15999996,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:48.839103 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id de8f02a4-b74f-47df-a797-bc3cbe7be366 {{(pid=92229) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:11:48.843265 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-03af1ba4-afeb-4eb4-bb35-132bdc4a0df6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:48.869412 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-6a197bae-e8af-4963-ab9b-5cec969219cb None None] Provisioning complete for port 47f62b29-867e-4af1-9330-02c97cb95473 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:11:48.869787 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-6a197bae-e8af-4963-ab9b-5cec969219cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:48.929889 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-5210747f-718c-4019-ada8-cfeb46ccbcb8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:48.944508 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-6a197bae-e8af-4963-ab9b-5cec969219cb None None] Port 47f62b29-867e-4af1-9330-02c97cb95473 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:11:48.953839 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 8e48657d-a82c-420f-8462-d947f458adb4 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:11:48.954026 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:48.964343 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-5210747f-718c-4019-ada8-cfeb46ccbcb8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:48.996614 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:49.030907 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-5210747f-718c-4019-ada8-cfeb46ccbcb8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:49.036138 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:49.052419 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5210747f-718c-4019-ada8-cfeb46ccbcb8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=89baa747-ab1a-46f3-96c0-f41f15999996,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:49.055113 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-5210747f-718c-4019-ada8-cfeb46ccbcb8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:49.064547 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-5210747f-718c-4019-ada8-cfeb46ccbcb8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:49.077085 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-5210747f-718c-4019-ada8-cfeb46ccbcb8 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/89baa747-ab1a-46f3-96c0-f41f15999996 HTTP/1.1" status: 204  len: 168 time: 0.2329154
Jun 01 06:11:49.137840 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device e157eec0-3394-4fbf-8701-c05f500f506a up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:11:49.169941 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Transition to ACTIVE for port object de8f02a4-b74f-47df-a797-bc3cbe7be366 will not be triggered until provisioned by entity L2. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:11:49.214288 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:49.223055 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port e157eec0-3394-4fbf-8701-c05f500f506a completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:11:49.230985 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port e157eec0-3394-4fbf-8701-c05f500f506a triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:11:49.231696 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:49.250272 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-10cc5533-df8f-47ef-86c6-3e2a1a455704 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:49.383192 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:49.405127 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port e157eec0-3394-4fbf-8701-c05f500f506a, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=e157eec0-3394-4fbf-8701-c05f500f506a,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:11:49.411350 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:49.416230 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:49.488674 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=e157eec0-3394-4fbf-8701-c05f500f506a,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:49.494946 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 59510) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:49.500352 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:49.516069 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-00d83b41-16ba-4158-a85f-548046345f08 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:49.532480 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-00d83b41-16ba-4158-a85f-548046345f08 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:49.536583 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-00d83b41-16ba-4158-a85f-548046345f08 admin admin] Usage tracker for resource:security_group_rule and tenant:34d62421c97a4f3984f38b3699b50e81 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:49.539543 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-00d83b41-16ba-4158-a85f-548046345f08 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:49.546869 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-00d83b41-16ba-4158-a85f-548046345f08 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:49.554620 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-10cc5533-df8f-47ef-86c6-3e2a1a455704 admin admin] Router b7bdc21e-592c-4bbf-87c9-5eba5676579e has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92229) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:11:49.604152 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:49.611352 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ce554e3c-28b0-4dd7-b4a3-1e41fd5f3855 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:49.649279 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Pushing event updated for resources: {'Port': ['ID=de8f02a4-b74f-47df-a797-bc3cbe7be366,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:49.668612 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-00d83b41-16ba-4158-a85f-548046345f08 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:49.672254 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.422s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:49.675064 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-00d83b41-16ba-4158-a85f-548046345f08 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:49.679966 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccbaf44e-259e-45a9-8ec6-dab0ef625130 req-2739555d-3f13-46ad-ae6a-a4b25149cb63 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:49.688230 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ccbaf44e-259e-45a9-8ec6-dab0ef625130 req-2739555d-3f13-46ad-ae6a-a4b25149cb63 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 931 time: 0.9033785
Jun 01 06:11:49.704339 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:49.715619 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-00d83b41-16ba-4158-a85f-548046345f08 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=34d62421c97a4f3984f38b3699b50e81&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2190573
Jun 01 06:11:49.719768 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 59522) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:49.764294 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00d83b41-16ba-4158-a85f-548046345f08 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=674f0426-9663-474b-852e-fcd5b9d87331,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:49.779310 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-00d83b41-16ba-4158-a85f-548046345f08 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:49.807937 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Attempting to bind port de8f02a4-b74f-47df-a797-bc3cbe7be366 on host hv-cinder-79388 for vnic_type normal with profile  {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:11:49.808349 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Attempting to bind port de8f02a4-b74f-47df-a797-bc3cbe7be366 by drivers openvswitch,hyperv on host hv-cinder-79388 at level 0 using segments [{'id': '7e12089c-d8cc-429c-8b7b-f5d148a55957', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 206, 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6'}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:11:49.809437 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Attempting to bind port de8f02a4-b74f-47df-a797-bc3cbe7be366 on network 8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:11:49.823711 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Port de8f02a4-b74f-47df-a797-bc3cbe7be366 on network 8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79388 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 06:11:49.824079 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Attempting to bind port de8f02a4-b74f-47df-a797-bc3cbe7be366 on network 8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:11:49.829380 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-dac4da19-4f28-4d74-966f-4d5228dfec9e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:49.859627 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Checking agent: {'id': '56148394-2131-4d06-bcfa-c032301591b8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79388', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'started_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 11, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:11:49.859911 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-dac4da19-4f28-4d74-966f-4d5228dfec9e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:49.859994 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Checking segment: {'id': '7e12089c-d8cc-429c-8b7b-f5d148a55957', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 206, 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:11:49.860590 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Bound using segment: {'id': '7e12089c-d8cc-429c-8b7b-f5d148a55957', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 206, 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6'} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:11:49.861353 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Bound port: de8f02a4-b74f-47df-a797-bc3cbe7be366, host: hv-cinder-79388, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7e12089c-d8cc-429c-8b7b-f5d148a55957', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 206, 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6'}}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:11:49.862870 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:49.926599 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-dac4da19-4f28-4d74-966f-4d5228dfec9e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:49.932033 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:49.943214 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dac4da19-4f28-4d74-966f-4d5228dfec9e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=674f0426-9663-474b-852e-fcd5b9d87331,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:49.947086 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-dac4da19-4f28-4d74-966f-4d5228dfec9e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:49.962234 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-dac4da19-4f28-4d74-966f-4d5228dfec9e admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:49.968540 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-dac4da19-4f28-4d74-966f-4d5228dfec9e admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/674f0426-9663-474b-852e-fcd5b9d87331 HTTP/1.1" status: 204  len: 168 time: 0.2449505
Jun 01 06:11:50.007013 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] For port de8f02a4-b74f-47df-a797-bc3cbe7be366, host hv-cinder-79388, cleared binding levels {{(pid=92229) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:11:50.025700 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ccbaf44e-259e-45a9-8ec6-dab0ef625130 req-b8d6ab71-7da0-4822-ae00-5f7aa6a54310 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3363171
Jun 01 06:11:50.032396 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] For port de8f02a4-b74f-47df-a797-bc3cbe7be366, host hv-cinder-79388, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=de8f02a4-b74f-47df-a797-bc3cbe7be366,segment=NetworkSegment(7e12089c-d8cc-429c-8b7b-f5d148a55957),segment_id=7e12089c-d8cc-429c-8b7b-f5d148a55957)] {{(pid=92229) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:11:50.066438 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device e157eec0-3394-4fbf-8701-c05f500f506a up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:11:50.154638 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port e157eec0-3394-4fbf-8701-c05f500f506a triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:11:50.154991 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:50.197260 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:50.227485 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-cde92e6f-cadf-4254-a022-02bc84f370f1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:50.337746 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:50.378509 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:11:50.390085 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:50.390702 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:50.392140 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] 10.222.0.48 "PUT /v2.0/ports/de8f02a4-b74f-47df-a797-bc3cbe7be366 HTTP/1.1" status: 200  len: 1093 time: 6.3585620
Jun 01 06:11:50.394671 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:11:50.397236 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-10cc5533-df8f-47ef-86c6-3e2a1a455704 admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92229) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:11:50.398971 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ce554e3c-28b0-4dd7-b4a3-1e41fd5f3855 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:50.399595 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5967d75f-2870-4a80-98ec-b2547cff266e', 'tag': 'de8f02a4-b74f-47df-a797-bc3cbe7be366'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:11:50.412039 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] Sync routers for ids ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'] in dv-cinder-793885-1-iscsi {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:11:50.439070 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] Routers {'b7bdc21e-592c-4bbf-87c9-5eba5676579e'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:11:50.440255 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2417340>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:11:43Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:11:50.573518 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:11:50.599207 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-10cc5533-df8f-47ef-86c6-3e2a1a455704 admin admin] 10.222.0.25 "PUT /v2.0/routers/b7bdc21e-592c-4bbf-87c9-5eba5676579e/add_router_interface HTTP/1.1" status: 200  len: 503 time: 17.5124307
Jun 01 06:11:50.647605 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Pushing event updated for resources: {'Port': ['ID=de8f02a4-b74f-47df-a797-bc3cbe7be366,revision_number=3']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:50.649651 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.422s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:50.664831 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] Set router b7bdc21e-592c-4bbf-87c9-5eba5676579e gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:11:50.701473 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.332s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:50.783388 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Pushing event updated for resources: {'Port': ['ID=7a40d370-1281-480c-bb6e-357e54ee6080,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:50.834293 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ce554e3c-28b0-4dd7-b4a3-1e41fd5f3855 admin admin] Network 6e45a0e5-f930-4b18-8f4f-1693815eb31a is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:11:50.848438 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-ce554e3c-28b0-4dd7-b4a3-1e41fd5f3855 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:11:50.850942 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce554e3c-28b0-4dd7-b4a3-1e41fd5f3855 admin admin] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:11:50.851414 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ce554e3c-28b0-4dd7-b4a3-1e41fd5f3855 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-744049'] for router_interface, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:50.872973 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8dbf0b5-73f0-4e92-bc88-9f82a117e68a req-5c162ef3-0c26-416b-9dec-a9bcafd8b15b tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:50.874853 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e8dbf0b5-73f0-4e92-bc88-9f82a117e68a req-5c162ef3-0c26-416b-9dec-a9bcafd8b15b tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/ports?device_id=b662816d-f3d5-434d-b2c3-eb501ac85556 HTTP/1.1" status: 200  len: 944 time: 0.8710299
Jun 01 06:11:50.967337 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:50.997631 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce554e3c-28b0-4dd7-b4a3-1e41fd5f3855 admin admin] Pushing event updated for resources: {'Port': ['ID=5a0fb2e6-0298-4b76-b4ad-e89873a54e08,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:51.001196 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ce554e3c-28b0-4dd7-b4a3-1e41fd5f3855 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.299s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:51.013387 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.369s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:51.013814 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.001s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:51.021110 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b4d36093-60b4-4b23-ab91-cfd9e1719046" -d '{"events": [{"name": "network-changed", "server_uuid": "5967d75f-2870-4a80-98ec-b2547cff266e", "tag": "de8f02a4-b74f-47df-a797-bc3cbe7be366"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:11:51.037373 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e8dbf0b5-73f0-4e92-bc88-9f82a117e68a req-214f3d7d-1dd0-486a-b627-0123197a2ef0 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/security-groups?id=322d6e24-5243-409c-8b80-acbe06176a3c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1408587
Jun 01 06:11:51.088926 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-a4dc09a3-c997-44d3-9d75-095e47b174e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:51.091128 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-a4dc09a3-c997-44d3-9d75-095e47b174e6 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=b02068c8f29e4f5e9b3c965d023f7e29&device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 1096 time: 0.5198796
Jun 01 06:11:51.098834 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2417340>, [{'id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'name': 'tempest-AttachVolumeShelveTestJSON-921884409-router', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20'}], 'enable_snat': True}, 'gw_port_id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:24Z', 'updated_at': '2021-06-01T06:11:44Z', 'revision_number': 4, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'gw_port': {'id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:b4:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:27Z', 'updated_at': '2021-06-01T06:11:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '47f62b29-867e-4af1-9330-02c97cb95473', 'name': '', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'mac_address': 'fa:16:3e:8c:f8:65', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:39Z', 'updated_at': '2021-06-01T06:11:46Z', 'revision_number': 2, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'subnets': [{'id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:11:51.104911 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] Checking router: b7bdc21e-592c-4bbf-87c9-5eba5676579e for host: dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:11:51.106131 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] Updating router b7bdc21e-592c-4bbf-87c9-5eba5676579e port 47f62b29-867e-4af1-9330-02c97cb95473 binding host dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 06:11:51.165229 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:51.259035 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:51.320768 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-0113f670-e2b4-46c6-a9db-d4c776fae376 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=de8f02a4-b74f-47df-a797-bc3cbe7be366 HTTP/1.1" status: 200  len: 217 time: 0.2196715
Jun 01 06:11:51.449606 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-cb6f95f7-dd8f-4989-b324-e5238a8f4566 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:51.462147 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-cb6f95f7-dd8f-4989-b324-e5238a8f4566 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=52a5c0c8-e902-4e55-bfa8-495f043331da HTTP/1.1" status: 200  len: 854 time: 0.1116087
Jun 01 06:11:51.555121 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 59610) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:51.555601 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:11:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cc661f18-1980-453a-8638-f7852dc3a5a2 x-openstack-request-id: req-cc661f18-1980-453a-8638-f7852dc3a5a2 {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:11:51.555858 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5967d75f-2870-4a80-98ec-b2547cff266e", "tag": "de8f02a4-b74f-47df-a797-bc3cbe7be366", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:11:51.556128 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-cc661f18-1980-453a-8638-f7852dc3a5a2 {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:11:51.556613 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5967d75f-2870-4a80-98ec-b2547cff266e', 'tag': 'de8f02a4-b74f-47df-a797-bc3cbe7be366', 'status': 'completed', 'code': 200}
Jun 01 06:11:51.562914 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-3283840d-31f1-4f6b-91bb-3b5e5f053f18 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Request body: {'security_group': {'name': 'tempest-securitygroup--350510649', 'description': 'tempest-description--499292279'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:51.578228 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-3283840d-31f1-4f6b-91bb-3b5e5f053f18 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:51.595295 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-3283840d-31f1-4f6b-91bb-3b5e5f053f18 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Usage tracker for resource:security_group and tenant:0f63ca6fed3e47a6a676979240aef5c0 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:51.599299 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-3283840d-31f1-4f6b-91bb-3b5e5f053f18 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:51.606797 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-1def0a09-1660-4c00-b296-749ed57bf301 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1324909
Jun 01 06:11:51.612683 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-3283840d-31f1-4f6b-91bb-3b5e5f053f18 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:51.648747 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3283840d-31f1-4f6b-91bb-3b5e5f053f18 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:51.663949 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device dad38687-d35c-4b39-9dd6-26cb8f3ec5a7 details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:11:51.690237 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-3283840d-31f1-4f6b-91bb-3b5e5f053f18 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:51.695992 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-3283840d-31f1-4f6b-91bb-3b5e5f053f18 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Usage tracker for resource:security_group_rule and tenant:0f63ca6fed3e47a6a676979240aef5c0 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:51.701492 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-3283840d-31f1-4f6b-91bb-3b5e5f053f18 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:51.709785 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-3283840d-31f1-4f6b-91bb-3b5e5f053f18 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:51.904775 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3283840d-31f1-4f6b-91bb-3b5e5f053f18 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:51.915341 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3283840d-31f1-4f6b-91bb-3b5e5f053f18 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:51.928342 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:52.032279 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port dad38687-d35c-4b39-9dd6-26cb8f3ec5a7, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=dad38687-d35c-4b39-9dd6-26cb8f3ec5a7,segment=NetworkSegment(2ae86fef-efbf-4f06-98a8-03571bcdb7ca),segment_id=2ae86fef-efbf-4f06-98a8-03571bcdb7ca)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:11:52.039921 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] Notify callbacks [] for port, precommit_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:52.071732 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.provisioning_blocks [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] Transition to ACTIVE for port object 47f62b29-867e-4af1-9330-02c97cb95473 will not be triggered until provisioned by entity L2. {{(pid=92232) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:11:52.079924 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': 'dad38687-d35c-4b39-9dd6-26cb8f3ec5a7', 'network_id': 'a3095bbd-0ae1-463e-b1b5-d29b58112d63', 'port_id': 'dad38687-d35c-4b39-9dd6-26cb8f3ec5a7', 'mac_address': 'fa:16:3e:b9:3a:0d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 233, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5d7e3531-6a32-40da-9550-2584d9bd4210', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:11:52.085189 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:52.107485 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:52.119444 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3283840d-31f1-4f6b-91bb-3b5e5f053f18 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:52.120708 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-3283840d-31f1-4f6b-91bb-3b5e5f053f18 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1778 time: 0.5635216
Jun 01 06:11:52.141367 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 59630) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:52.154572 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3283840d-31f1-4f6b-91bb-3b5e5f053f18 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d244799f-12ae-4ce0-9252-891377721dbc,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:52.159982 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-3283840d-31f1-4f6b-91bb-3b5e5f053f18 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.232s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:52.174011 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-49c846a5-8480-431f-b82c-197a74caa68e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Request body: {'security_group_rule': {'security_group_id': 'd244799f-12ae-4ce0-9252-891377721dbc', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:52.185654 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-49c846a5-8480-431f-b82c-197a74caa68e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:52.194701 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-49c846a5-8480-431f-b82c-197a74caa68e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Usage tracker for resource:security_group_rule and tenant:0f63ca6fed3e47a6a676979240aef5c0 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:52.203590 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-49c846a5-8480-431f-b82c-197a74caa68e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:52.219718 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-49c846a5-8480-431f-b82c-197a74caa68e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:52.262646 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35596c19-72f7-4ba1-9bdc-3b0a399e5fcb None None] Pushing event updated for resources: {'Port': ['ID=47f62b29-867e-4af1-9330-02c97cb95473,revision_number=3']} {{(pid=92232) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:52.265994 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-49c846a5-8480-431f-b82c-197a74caa68e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:52.286323 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:52.287257 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-35596c19-72f7-4ba1-9bdc-3b0a399e5fcb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:52.344002 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id dad38687-d35c-4b39-9dd6-26cb8f3ec5a7 {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:11:52.389714 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port dad38687-d35c-4b39-9dd6-26cb8f3ec5a7, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=dad38687-d35c-4b39-9dd6-26cb8f3ec5a7,segment=NetworkSegment(2ae86fef-efbf-4f06-98a8-03571bcdb7ca),segment_id=2ae86fef-efbf-4f06-98a8-03571bcdb7ca)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:11:52.398372 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:52.403998 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:52.462957 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-49c846a5-8480-431f-b82c-197a74caa68e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:52.474114 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-49c846a5-8480-431f-b82c-197a74caa68e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:52.488812 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e821896c-41de-4670-9ece-0b9734d7ddb0 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:52.506231 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-b84c8438-eca2-47f2-9b82-d0ac19e88708 service neutron] 10.222.0.48 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.8878167
Jun 01 06:11:52.537859 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-49c846a5-8480-431f-b82c-197a74caa68e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:52.538779 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=dad38687-d35c-4b39-9dd6-26cb8f3ec5a7,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:52.542458 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:52.543934 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-49c846a5-8480-431f-b82c-197a74caa68e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3785179
Jun 01 06:11:52.545016 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49c846a5-8480-431f-b82c-197a74caa68e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=080109e4-6bb3-4ee7-a0ad-c465e25be02e,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:52.548660 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-49c846a5-8480-431f-b82c-197a74caa68e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:52.549187 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 59642) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:52.561179 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-a742ab03-5602-4901-b626-0ba8460b291b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Request body: {'security_group_rule': {'security_group_id': 'd244799f-12ae-4ce0-9252-891377721dbc', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:52.575661 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-a742ab03-5602-4901-b626-0ba8460b291b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:52.582021 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-a742ab03-5602-4901-b626-0ba8460b291b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Usage tracker for resource:security_group_rule and tenant:0f63ca6fed3e47a6a676979240aef5c0 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:52.583671 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] Attempting to bind port 47f62b29-867e-4af1-9330-02c97cb95473 on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:11:52.584060 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] Attempting to bind port 47f62b29-867e-4af1-9330-02c97cb95473 by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': '79adeacf-7d8b-48ea-a63b-df4d7bfff135', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 245, 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2'}] {{(pid=92232) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:11:52.584499 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] Attempting to bind port 47f62b29-867e-4af1-9330-02c97cb95473 on network 5f973ed4-521b-4b78-9a54-1336b1302fa2 {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:11:52.589283 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-a742ab03-5602-4901-b626-0ba8460b291b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:52.596845 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-a742ab03-5602-4901-b626-0ba8460b291b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:52.599699 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 11, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:11:52.600706 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] Checking segment: {'id': '79adeacf-7d8b-48ea-a63b-df4d7bfff135', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 245, 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92232) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:11:52.601684 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:52.602530 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] Bound using segment: {'id': '79adeacf-7d8b-48ea-a63b-df4d7bfff135', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 245, 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2'} {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:11:52.603904 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] Bound port: 47f62b29-867e-4af1-9330-02c97cb95473, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '79adeacf-7d8b-48ea-a63b-df4d7bfff135', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 245, 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2'}}] {{(pid=92232) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:11:52.605036 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:52.624521 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a742ab03-5602-4901-b626-0ba8460b291b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:52.648916 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['dad38687-d35c-4b39-9dd6-26cb8f3ec5a7'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:11:52.771757 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.db [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] For port 47f62b29-867e-4af1-9330-02c97cb95473, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92232) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:11:52.783212 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.db [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] For port 47f62b29-867e-4af1-9330-02c97cb95473, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=47f62b29-867e-4af1-9330-02c97cb95473,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92232) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:11:52.785142 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a742ab03-5602-4901-b626-0ba8460b291b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:52.792114 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a742ab03-5602-4901-b626-0ba8460b291b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:52.792266 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ce554e3c-28b0-4dd7-b4a3-1e41fd5f3855 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:52.793145 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:52.802426 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-165205a5-e3f1-4a1a-b169-f611156b79e8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:52.811008 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-49c846a5-8480-431f-b82c-197a74caa68e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:52.863441 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a742ab03-5602-4901-b626-0ba8460b291b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5aa7198a-e8dd-4e5a-bd1e-3452219aab36,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:52.872296 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-a742ab03-5602-4901-b626-0ba8460b291b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:52.890699 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a742ab03-5602-4901-b626-0ba8460b291b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:52.894249 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-a742ab03-5602-4901-b626-0ba8460b291b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.3435102
Jun 01 06:11:52.896997 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 59654) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:52.909531 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Request body: {'floatingip': {'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:11:52.927842 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:52.938686 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Usage tracker for resource:floatingip and tenant:0f63ca6fed3e47a6a676979240aef5c0 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:52.949706 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:52.979692 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:53.001044 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] Routers {'b7bdc21e-592c-4bbf-87c9-5eba5676579e'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:11:53.008045 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2417340>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:11:43Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:11:53.024920 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for floatingip, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:53.103366 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35596c19-72f7-4ba1-9bdc-3b0a399e5fcb None None] Pushing event updated for resources: {'Port': ['ID=47f62b29-867e-4af1-9330-02c97cb95473,revision_number=4']} {{(pid=92232) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:53.129718 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a1af3c7-87ed-4d53-9d87-86142b3ce8f6 req-12ecf14b-dfe3-493c-b730-756089de0a15 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:53.140151 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-35596c19-72f7-4ba1-9bdc-3b0a399e5fcb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.338s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:53.144395 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2a1af3c7-87ed-4d53-9d87-86142b3ce8f6 req-12ecf14b-dfe3-493c-b730-756089de0a15 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 943 time: 1.4207134
Jun 01 06:11:53.295331 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:53.348524 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] Set router b7bdc21e-592c-4bbf-87c9-5eba5676579e gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:11:53.439839 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.db.resource_extend [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] It took 0.23 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
Jun 01 06:11:53.471048 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9f83a54-dc15-4ef0-b953-aea97e8315b7 req-a33040b2-aa8f-4354-bf60-5821b29726be tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:53.485349 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b9f83a54-dc15-4ef0-b953-aea97e8315b7 req-a33040b2-aa8f-4354-bf60-5821b29726be tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/ports?device_id=b662816d-f3d5-434d-b2c3-eb501ac85556 HTTP/1.1" status: 200  len: 945 time: 1.1037002
Jun 01 06:11:53.493411 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-93943a4b-76d5-4e4a-979a-0516c1f29da8 req-4d1a042e-43e3-433c-b75e-1797810cff89 service neutron] 10.222.0.48 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.8578291
Jun 01 06:11:53.530421 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:53.616936 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:53.657238 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device dad38687-d35c-4b39-9dd6-26cb8f3ec5a7 up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:11:53.728133 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_common [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Allocated IP 172.27.2.242 (83b812fb-2cfc-46e4-baa4-745218ea3ed2/a59d7d11-a92c-4b4f-83cf-2095ecee2b51/cf6c2ad8-5168-4ef9-ac56-cdfd43ba02ee) {{(pid=92230) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:11:53.814435 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-8a8c16eb-f25c-4a62-a8ec-d75a7ae985a4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:53.816794 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 59672) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:53.969236 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning for port dad38687-d35c-4b39-9dd6-26cb8f3ec5a7 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:11:53.990431 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port dad38687-d35c-4b39-9dd6-26cb8f3ec5a7 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:11:53.992909 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:54.012163 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Pushing event updated for resources: {'Port': ['ID=7a40d370-1281-480c-bb6e-357e54ee6080,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:54.023454 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:54.145300 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for port, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:54.159230 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b9f83a54-dc15-4ef0-b953-aea97e8315b7 req-c9b12127-b04c-4293-b295-71cccf40bbc4 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/security-groups?id=322d6e24-5243-409c-8b80-acbe06176a3c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.6536307
Jun 01 06:11:54.176727 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-745720'] for floatingip, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:54.183370 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2a1af3c7-87ed-4d53-9d87-86142b3ce8f6 req-1066dad8-d5a5-4b28-a404-5274e8ddcb7d tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 1.0348098
Jun 01 06:11:54.217099 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2417340>, [{'id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'name': 'tempest-AttachVolumeShelveTestJSON-921884409-router', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20'}], 'enable_snat': True}, 'gw_port_id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:24Z', 'updated_at': '2021-06-01T06:11:44Z', 'revision_number': 4, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'gw_port': {'id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:b4:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:27Z', 'updated_at': '2021-06-01T06:11:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '47f62b29-867e-4af1-9330-02c97cb95473', 'name': '', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'mac_address': 'fa:16:3e:8c:f8:65', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:39Z', 'updated_at': '2021-06-01T06:11:52Z', 'revision_number': 4, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'subnets': [{'id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:11:54.227544 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa9b7c64-b46d-49d3-9d70-8ef82c63b607 None None] The sync data for ids ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'] in dv-cinder-793885-1-iscsi is: [{'id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'name': 'tempest-AttachVolumeShelveTestJSON-921884409-router', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20'}], 'enable_snat': True}, 'gw_port_id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:24Z', 'updated_at': '2021-06-01T06:11:44Z', 'revision_number': 4, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'gw_port': {'id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:b4:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:27Z', 'updated_at': '2021-06-01T06:11:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '47f62b29-867e-4af1-9330-02c97cb95473', 'name': '', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'mac_address': 'fa:16:3e:8c:f8:65', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:39Z', 'updated_at': '2021-06-01T06:11:52Z', 'revision_number': 4, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'subnets': [{'id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:11:54.230803 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:54.255963 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-15023012-433c-49fa-854d-01e8b7322535 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:54.274205 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:54.285363 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:54.350008 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b662816d-f3d5-434d-b2c3-eb501ac85556', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dad38687-d35c-4b39-9dd6-26cb8f3ec5a7'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:11:54.360753 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for floatingip, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:54.376925 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 692 time: 13.0669560
Jun 01 06:11:54.396268 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ce554e3c-28b0-4dd7-b4a3-1e41fd5f3855 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:54.407489 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ce554e3c-28b0-4dd7-b4a3-1e41fd5f3855 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:54.426956 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ce554e3c-28b0-4dd7-b4a3-1e41fd5f3855 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-582666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-744156'] for router_interface, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:54.427338 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Pushing event updated for resources: {'Port': ['ID=cf6c2ad8-5168-4ef9-ac56-cdfd43ba02ee,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:54.431339 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:54.432565 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d36093-60b4-4b23-ab91-cfd9e1719046 req-2d56b776-66ae-4032-9cd8-3e1adb6a1183 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:54.436367 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b4d36093-60b4-4b23-ab91-cfd9e1719046 req-2d56b776-66ae-4032-9cd8-3e1adb6a1183 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=b02068c8f29e4f5e9b3c965d023f7e29&device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 1096 time: 0.8563282
Jun 01 06:11:54.438208 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:54.441309 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port dad38687-d35c-4b39-9dd6-26cb8f3ec5a7, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=dad38687-d35c-4b39-9dd6-26cb8f3ec5a7,segment=NetworkSegment(2ae86fef-efbf-4f06-98a8-03571bcdb7ca),segment_id=2ae86fef-efbf-4f06-98a8-03571bcdb7ca)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:11:54.446399 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-15023012-433c-49fa-854d-01e8b7322535 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:54.454082 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:54.455038 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:11:54.456143 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:54.456267 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-15023012-433c-49fa-854d-01e8b7322535 admin admin] Usage tracker for resource:security_group_rule and tenant:a5e5d311ffe54cd1b5ec5a8df5ba3076 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:54.459875 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:11:54.464240 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-15023012-433c-49fa-854d-01e8b7322535 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:54.468678 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Received port after_create {{(pid=92230) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:11:54.564316 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:54.587370 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-15023012-433c-49fa-854d-01e8b7322535 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:54.610913 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=dad38687-d35c-4b39-9dd6-26cb8f3ec5a7,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:54.622713 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:54.631303 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce554e3c-28b0-4dd7-b4a3-1e41fd5f3855 admin admin] Pushing event updated for resources: {'Port': ['ID=5a0fb2e6-0298-4b76-b4ad-e89873a54e08,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:54.636351 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ce554e3c-28b0-4dd7-b4a3-1e41fd5f3855 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:54.691214 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7d581356-1fb6-44e1-af0d-db27437d51ba" -d '{"events": [{"server_uuid": "b662816d-f3d5-434d-b2c3-eb501ac85556", "name": "network-vif-plugged", "status": "completed", "tag": "dad38687-d35c-4b39-9dd6-26cb8f3ec5a7"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:11:54.789259 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:54.859411 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:11:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a5491457-cd3f-4df6-848e-076a8c6c7922 x-openstack-request-id: req-a5491457-cd3f-4df6-848e-076a8c6c7922 {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:11:54.859411 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b662816d-f3d5-434d-b2c3-eb501ac85556", "name": "network-vif-plugged", "status": "completed", "tag": "dad38687-d35c-4b39-9dd6-26cb8f3ec5a7", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:11:54.859411 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-a5491457-cd3f-4df6-848e-076a8c6c7922 {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:11:54.859411 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b662816d-f3d5-434d-b2c3-eb501ac85556', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dad38687-d35c-4b39-9dd6-26cb8f3ec5a7', 'code': 200}
Jun 01 06:11:54.899930 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-fa4c9a06-f454-4ae0-a735-c07cc92d07da tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Synchronizing usage tracker for tenant:ac4006667c3442a3910d548e9e9d22c0 on resource:security_group {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:11:54.928098 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ce554e3c-28b0-4dd7-b4a3-1e41fd5f3855 admin admin] Network 6e45a0e5-f930-4b18-8f4f-1693815eb31a is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:11:54.929453 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-ce554e3c-28b0-4dd7-b4a3-1e41fd5f3855 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:11:55.044735 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-15023012-433c-49fa-854d-01e8b7322535 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:55.092773 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-15023012-433c-49fa-854d-01e8b7322535 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:55.111913 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:55.142583 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-fa4c9a06-f454-4ae0-a735-c07cc92d07da tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Unset dirty status for tenant:ac4006667c3442a3910d548e9e9d22c0 on resource:security_group {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:11:55.143829 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-fa4c9a06-f454-4ae0-a735-c07cc92d07da tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-securitygroup--1918997533&fields=id&tenant_id=ac4006667c3442a3910d548e9e9d22c0 HTTP/1.1" status: 200  len: 267 time: 0.3374474
Jun 01 06:11:55.175745 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-15023012-433c-49fa-854d-01e8b7322535 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=a5e5d311ffe54cd1b5ec5a8df5ba3076&name=default HTTP/1.1" status: 200  len: 2979 time: 1.3534670
Jun 01 06:11:55.175745 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15023012-433c-49fa-854d-01e8b7322535 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b4ddca20-018a-46dd-bde9-96398f256348,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:55.176683 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 59706) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:55.179317 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-15023012-433c-49fa-854d-01e8b7322535 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:55.228303 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for port, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:55.270761 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ce554e3c-28b0-4dd7-b4a3-1e41fd5f3855 admin admin] Router ea184dcf-09ad-4302-82aa-16ce19e6c1e5 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92229) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:11:55.286562 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:55.304429 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:55.373057 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-13497044-2aa4-4a3b-bbe7-dfb2f2758da7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:55.375428 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-745720'] for floatingip, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:55.450829 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for floatingip, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:55.473370 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 2.5530741
Jun 01 06:11:55.473370 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Pushing event updated for resources: {'Port': ['ID=cf6c2ad8-5168-4ef9-ac56-cdfd43ba02ee,revision_number=2']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:55.473370 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:55.503120 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-13497044-2aa4-4a3b-bbe7-dfb2f2758da7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:55.577736 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-13497044-2aa4-4a3b-bbe7-dfb2f2758da7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:55.582639 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:55.595724 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13497044-2aa4-4a3b-bbe7-dfb2f2758da7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b4ddca20-018a-46dd-bde9-96398f256348,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:55.598453 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-13497044-2aa4-4a3b-bbe7-dfb2f2758da7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:55.606705 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-13497044-2aa4-4a3b-bbe7-dfb2f2758da7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:55.607998 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-13497044-2aa4-4a3b-bbe7-dfb2f2758da7 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/b4ddca20-018a-46dd-bde9-96398f256348 HTTP/1.1" status: 204  len: 168 time: 0.4306583
Jun 01 06:11:55.866015 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-5bb8f878-85bd-4ab0-9d49-446782db4967 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:55.867308 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-5bb8f878-85bd-4ab0-9d49-446782db4967 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Synchronizing usage tracker for tenant:ac4006667c3442a3910d548e9e9d22c0 on resource:network {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:11:55.994116 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-5bb8f878-85bd-4ab0-9d49-446782db4967 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Unset dirty status for tenant:ac4006667c3442a3910d548e9e9d22c0 on resource:network {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:11:55.995313 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-5bb8f878-85bd-4ab0-9d49-446782db4967 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/networks?id=0890ab9c-2266-4ef4-af73-d3ff421b9bd7 HTTP/1.1" status: 200  len: 811 time: 0.8379533
Jun 01 06:11:56.001230 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ce554e3c-28b0-4dd7-b4a3-1e41fd5f3855 admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92229) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:11:56.014881 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdd55d21-432f-4c5c-a814-c52f3a66beb4 req-4712c71e-5de0-4484-a497-3c0cc50765f8 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:56.015597 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] Sync routers for ids ['ea184dcf-09ad-4302-82aa-16ce19e6c1e5'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:11:56.016460 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bdd55d21-432f-4c5c-a814-c52f3a66beb4 req-4712c71e-5de0-4484-a497-3c0cc50765f8 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 943 time: 0.6869800
Jun 01 06:11:56.030327 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-ce554e3c-28b0-4dd7-b4a3-1e41fd5f3855 admin admin] 10.222.0.25 "PUT /v2.0/routers/ea184dcf-09ad-4302-82aa-16ce19e6c1e5/add_router_interface HTTP/1.1" status: 200  len: 503 time: 16.0194073
Jun 01 06:11:56.041517 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] Routers {'ea184dcf-09ad-4302-82aa-16ce19e6c1e5'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:11:56.057922 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2526a90>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:11:43Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['ea184dcf-09ad-4302-82aa-16ce19e6c1e5'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:11:56.061273 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-d6599052-d783-4fd6-9cfa-0739eb80a337 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/quotas/ac4006667c3442a3910d548e9e9d22c0 HTTP/1.1" status: 200  len: 375 time: 0.0436263
Jun 01 06:11:56.062074 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 59726) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:56.115198 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-46f9ae93-d6b7-4c01-81a7-99c0dda8922d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:56.154386 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bdd55d21-432f-4c5c-a814-c52f3a66beb4 req-f321815a-10a9-4a54-a46d-d13ddff4db3c tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1211948
Jun 01 06:11:56.196316 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-46f9ae93-d6b7-4c01-81a7-99c0dda8922d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:56.225121 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-46f9ae93-d6b7-4c01-81a7-99c0dda8922d admin admin] Usage tracker for resource:security_group_rule and tenant:8f85dd29493d4561b8046bf5fcd942f4 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:56.252057 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-46f9ae93-d6b7-4c01-81a7-99c0dda8922d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:56.256392 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-138d11a4-cf81-4904-ac1f-001fb60d7a9c tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=ac4006667c3442a3910d548e9e9d22c0&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1810327
Jun 01 06:11:56.260751 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-46f9ae93-d6b7-4c01-81a7-99c0dda8922d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:56.301377 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 47f62b29-867e-4af1-9330-02c97cb95473 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:11:56.376006 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] Set router ea184dcf-09ad-4302-82aa-16ce19e6c1e5 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:11:56.460532 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-46f9ae93-d6b7-4c01-81a7-99c0dda8922d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:56.467225 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-46f9ae93-d6b7-4c01-81a7-99c0dda8922d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:56.490072 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-13497044-2aa4-4a3b-bbe7-dfb2f2758da7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:56.547132 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-63bc09ee-49ea-4409-8abe-21f03a6f7192 service neutron] 10.222.0.25 "GET /v2.0/networks/0890ab9c-2266-4ef4-af73-d3ff421b9bd7?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2269919
Jun 01 06:11:56.557192 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7b8590a-5739-403e-918d-44a3f013cc44 req-66fbaf0f-0bdc-4dec-90a1-374f1eaefb30 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:56.565089 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f7b8590a-5739-403e-918d-44a3f013cc44 req-66fbaf0f-0bdc-4dec-90a1-374f1eaefb30 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/ports?device_id=b662816d-f3d5-434d-b2c3-eb501ac85556 HTTP/1.1" status: 200  len: 946 time: 0.2158899
Jun 01 06:11:56.589440 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-46f9ae93-d6b7-4c01-81a7-99c0dda8922d admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=8f85dd29493d4561b8046bf5fcd942f4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5259643
Jun 01 06:11:56.594749 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 59738) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:56.626729 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46f9ae93-d6b7-4c01-81a7-99c0dda8922d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f759f914-7e29-4884-9097-efe1303df01e,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:56.647562 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-46f9ae93-d6b7-4c01-81a7-99c0dda8922d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:56.713161 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f7b8590a-5739-403e-918d-44a3f013cc44 req-49798b5c-e920-4038-b3b0-2f17f12b7c27 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/security-groups?id=322d6e24-5243-409c-8b80-acbe06176a3c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1469007
Jun 01 06:11:56.729838 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f30451cd-526e-481a-995a-a414f1fdda13 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:56.745517 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port 47f62b29-867e-4af1-9330-02c97cb95473 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:11:56.763962 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 47f62b29-867e-4af1-9330-02c97cb95473 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:11:56.764343 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:56.769364 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-e371957e-aefd-47b5-bc0c-6b8dff07c747 service neutron] 10.222.0.25 "GET /v2.0/networks/0890ab9c-2266-4ef4-af73-d3ff421b9bd7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1823344
Jun 01 06:11:56.806926 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f30451cd-526e-481a-995a-a414f1fdda13 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:56.890898 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f30451cd-526e-481a-995a-a414f1fdda13 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:56.894648 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-dd19f366-3d13-4cf5-90ad-b856e3423647 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Synchronizing usage tracker for tenant:0f63ca6fed3e47a6a676979240aef5c0 on resource:security_group {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:11:56.899903 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:56.916548 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f30451cd-526e-481a-995a-a414f1fdda13 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f759f914-7e29-4884-9097-efe1303df01e,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:56.920595 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-dd19f366-3d13-4cf5-90ad-b856e3423647 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Unset dirty status for tenant:0f63ca6fed3e47a6a676979240aef5c0 on resource:security_group {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:11:56.926927 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-f30451cd-526e-481a-995a-a414f1fdda13 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:56.930295 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f30451cd-526e-481a-995a-a414f1fdda13 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:56.931035 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-dd19f366-3d13-4cf5-90ad-b856e3423647 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-securitygroup--350510649&fields=id&tenant_id=0f63ca6fed3e47a6a676979240aef5c0 HTTP/1.1" status: 200  len: 267 time: 0.0851367
Jun 01 06:11:56.932097 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-f30451cd-526e-481a-995a-a414f1fdda13 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/f759f914-7e29-4884-9097-efe1303df01e HTTP/1.1" status: 204  len: 168 time: 0.3359878
Jun 01 06:11:57.005772 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:57.140880 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port 47f62b29-867e-4af1-9330-02c97cb95473, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=47f62b29-867e-4af1-9330-02c97cb95473,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:11:57.155572 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:57.157394 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-5ce6c016-b384-4261-a142-f1cd9a10f238 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:57.158435 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-5ce6c016-b384-4261-a142-f1cd9a10f238 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Synchronizing usage tracker for tenant:0f63ca6fed3e47a6a676979240aef5c0 on resource:network {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:11:57.162783 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-430bc3fb-0db8-4302-9951-c0e530eee0d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:57.217426 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-5ce6c016-b384-4261-a142-f1cd9a10f238 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Unset dirty status for tenant:0f63ca6fed3e47a6a676979240aef5c0 on resource:network {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:11:57.219081 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-5ce6c016-b384-4261-a142-f1cd9a10f238 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/networks?id=5f973ed4-521b-4b78-9a54-1336b1302fa2 HTTP/1.1" status: 200  len: 816 time: 0.2870629
Jun 01 06:11:57.255630 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2526a90>, [{'id': 'ea184dcf-09ad-4302-82aa-16ce19e6c1e5', 'name': 'tempest-ServerRescueNegativeTestJSON-979777158-router', 'tenant_id': '8f1cf739e243401eb5da7ee705e856de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.222'}], 'enable_snat': True}, 'gw_port_id': 'e157eec0-3394-4fbf-8701-c05f500f506a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:51Z', 'revision_number': 4, 'project_id': '8f1cf739e243401eb5da7ee705e856de', 'gw_port': {'id': 'e157eec0-3394-4fbf-8701-c05f500f506a', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:84:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea184dcf-09ad-4302-82aa-16ce19e6c1e5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.222', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:29Z', 'updated_at': '2021-06-01T06:11:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '5a0fb2e6-0298-4b76-b4ad-e89873a54e08', 'name': '', 'network_id': '6e45a0e5-f930-4b18-8f4f-1693815eb31a', 'tenant_id': '8f1cf739e243401eb5da7ee705e856de', 'mac_address': 'fa:16:3e:bf:d7:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea184dcf-09ad-4302-82aa-16ce19e6c1e5', 'device_owner': 'network:router_interface', 'standard_attr_id': 109, 'fixed_ips': [{'subnet_id': '84c296fc-69c0-46e2-b1ed-e3edf435b759', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:47Z', 'updated_at': '2021-06-01T06:11:53Z', 'revision_number': 2, 'project_id': '8f1cf739e243401eb5da7ee705e856de', 'subnets': [{'id': '84c296fc-69c0-46e2-b1ed-e3edf435b759', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:11:57.282883 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] Checking router: ea184dcf-09ad-4302-82aa-16ce19e6c1e5 for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:11:57.283240 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] Updating router ea184dcf-09ad-4302-82aa-16ce19e6c1e5 port 5a0fb2e6-0298-4b76-b4ad-e89873a54e08 binding host dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 06:11:57.311669 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-8bd5346d-3acf-4536-ae36-1336cbd367c9 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/quotas/0f63ca6fed3e47a6a676979240aef5c0 HTTP/1.1" status: 200  len: 375 time: 0.0221918
Jun 01 06:11:57.392717 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=47f62b29-867e-4af1-9330-02c97cb95473,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:57.407561 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:57.422590 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.260s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:57.732024 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device de8f02a4-b74f-47df-a797-bc3cbe7be366 details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:11:57.768585 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49520d11-ed48-4da2-9407-58d053028e54 req-e97837e8-21fa-4c01-8898-92123cd16a36 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:57.769980 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-49520d11-ed48-4da2-9407-58d053028e54 req-e97837e8-21fa-4c01-8898-92123cd16a36 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=b662816d-f3d5-434d-b2c3-eb501ac85556 HTTP/1.1" status: 200  len: 1099 time: 0.2022460
Jun 01 06:11:57.781775 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-7a507176-22d4-475a-8c3d-00a4f2c6778c tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:57.782664 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-7a507176-22d4-475a-8c3d-00a4f2c6778c tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Synchronizing usage tracker for tenant:8f1cf739e243401eb5da7ee705e856de on resource:network {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:11:57.841948 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-49520d11-ed48-4da2-9407-58d053028e54 req-a4e99c22-44fe-4481-8320-641391afa6e5 service neutron] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:57.874917 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-7a507176-22d4-475a-8c3d-00a4f2c6778c tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Unset dirty status for tenant:8f1cf739e243401eb5da7ee705e856de on resource:network {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:11:57.879534 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [req-49520d11-ed48-4da2-9407-58d053028e54 req-a4e99c22-44fe-4481-8320-641391afa6e5 service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:57.886978 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-7a507176-22d4-475a-8c3d-00a4f2c6778c tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/networks?id=6e45a0e5-f930-4b18-8f4f-1693815eb31a HTTP/1.1" status: 200  len: 818 time: 0.5957065
Jun 01 06:11:57.887443 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-49520d11-ed48-4da2-9407-58d053028e54 req-a4e99c22-44fe-4481-8320-641391afa6e5 service neutron] Usage tracker for resource:security_group_rule and tenant:425177935298408eb3cf0461e02cb813 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:57.892863 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-49520d11-ed48-4da2-9407-58d053028e54 req-a4e99c22-44fe-4481-8320-641391afa6e5 service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:57.906640 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [req-49520d11-ed48-4da2-9407-58d053028e54 req-a4e99c22-44fe-4481-8320-641391afa6e5 service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:58.014825 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-817ad846-837d-46ae-9353-0fca7968a31b tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/quotas/8f1cf739e243401eb5da7ee705e856de HTTP/1.1" status: 200  len: 375 time: 0.1266282
Jun 01 06:11:58.052835 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.db.resource_extend [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
Jun 01 06:11:58.185215 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 47f62b29-867e-4af1-9330-02c97cb95473 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:11:58.194674 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d36093-60b4-4b23-ab91-cfd9e1719046 req-97e5cc34-d64b-4394-aec8-8218c514960e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:58.201111 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b4d36093-60b4-4b23-ab91-cfd9e1719046 req-97e5cc34-d64b-4394-aec8-8218c514960e service neutron] 10.222.0.48 "GET /v2.0/networks?id=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 HTTP/1.1" status: 200  len: 915 time: 1.0361431
Jun 01 06:11:58.208813 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-49520d11-ed48-4da2-9407-58d053028e54 req-a4e99c22-44fe-4481-8320-641391afa6e5 service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:58.218596 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-49520d11-ed48-4da2-9407-58d053028e54 req-a4e99c22-44fe-4481-8320-641391afa6e5 service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:58.266593 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:58.279211 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-49520d11-ed48-4da2-9407-58d053028e54 req-a4e99c22-44fe-4481-8320-641391afa6e5 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=322d6e24-5243-409c-8b80-acbe06176a3c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4906578
Jun 01 06:11:58.368437 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4e99c22-44fe-4481-8320-641391afa6e5 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=a4d9bb67-5958-4294-81e0-e9e68549191a,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:58.373531 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-a4e99c22-44fe-4481-8320-641391afa6e5 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:58.457465 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port de8f02a4-b74f-47df-a797-bc3cbe7be366, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=de8f02a4-b74f-47df-a797-bc3cbe7be366,segment=NetworkSegment(7e12089c-d8cc-429c-8b7b-f5d148a55957),segment_id=7e12089c-d8cc-429c-8b7b-f5d148a55957)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:11:58.470892 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b4d36093-60b4-4b23-ab91-cfd9e1719046 req-770446c0-eb07-46d6-8c3b-11c4ce2f3427 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=de8f02a4-b74f-47df-a797-bc3cbe7be366 HTTP/1.1" status: 200  len: 217 time: 0.2419646
Jun 01 06:11:58.489297 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-5aec65ed-033e-4778-9cc4-c20641fa95e3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Synchronizing usage tracker for tenant:0f63ca6fed3e47a6a676979240aef5c0 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:11:58.525788 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 59806) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:58.545936 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': 'de8f02a4-b74f-47df-a797-bc3cbe7be366', 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6', 'port_id': 'de8f02a4-b74f-47df-a797-bc3cbe7be366', 'mac_address': 'fa:16:3e:16:67:a8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 206, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '52a5c0c8-e902-4e55-bfa8-495f043331da', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:11:58.616704 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 47f62b29-867e-4af1-9330-02c97cb95473 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:11:58.617452 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:58.664334 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-5aec65ed-033e-4778-9cc4-c20641fa95e3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Unset dirty status for tenant:0f63ca6fed3e47a6a676979240aef5c0 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:11:58.665747 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-5aec65ed-033e-4778-9cc4-c20641fa95e3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=0f63ca6fed3e47a6a676979240aef5c0&fields=id HTTP/1.1" status: 200  len: 348 time: 1.1008704
Jun 01 06:11:58.774551 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d36093-60b4-4b23-ab91-cfd9e1719046 req-6045a0d9-8091-41a7-8b38-1f171665cd12 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:58.779202 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-264c630b-3afc-49b6-80ec-83cacf708933 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:58.782353 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b4d36093-60b4-4b23-ab91-cfd9e1719046 req-6045a0d9-8091-41a7-8b38-1f171665cd12 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=52a5c0c8-e902-4e55-bfa8-495f043331da HTTP/1.1" status: 200  len: 854 time: 0.2716238
Jun 01 06:11:58.819561 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-264c630b-3afc-49b6-80ec-83cacf708933 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:11:58.834385 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-264c630b-3afc-49b6-80ec-83cacf708933 admin admin] Usage tracker for resource:security_group_rule and tenant:50c300f7d5b04ea8a57614e73f962f19 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:11:58.837981 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-264c630b-3afc-49b6-80ec-83cacf708933 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:11:58.849699 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-264c630b-3afc-49b6-80ec-83cacf708933 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:11:58.867815 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] Notify callbacks [] for port, precommit_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:58.892845 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] Transition to ACTIVE for port object 5a0fb2e6-0298-4b76-b4ad-e89873a54e08 will not be triggered until provisioned by entity L2. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:11:58.923440 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:58.936739 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:59.034876 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-ab8ac1b8-424b-480a-86f8-6ec8d6eef2f9 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Synchronizing usage tracker for tenant:8f1cf739e243401eb5da7ee705e856de on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:11:59.076830 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f758f4d-8456-4249-be2d-aa8b090a0a44 None None] Pushing event updated for resources: {'Port': ['ID=5a0fb2e6-0298-4b76-b4ad-e89873a54e08,revision_number=3']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:59.080377 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b4d36093-60b4-4b23-ab91-cfd9e1719046 req-b46c2657-1054-44ce-948c-b51eae795f32 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.2872107
Jun 01 06:11:59.085827 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-0f758f4d-8456-4249-be2d-aa8b090a0a44 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:59.229643 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:59.292078 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id de8f02a4-b74f-47df-a797-bc3cbe7be366 {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:11:59.311462 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port de8f02a4-b74f-47df-a797-bc3cbe7be366, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=de8f02a4-b74f-47df-a797-bc3cbe7be366,segment=NetworkSegment(7e12089c-d8cc-429c-8b7b-f5d148a55957),segment_id=7e12089c-d8cc-429c-8b7b-f5d148a55957)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:11:59.334916 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:59.341767 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:59.345958 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-7ba3e2d9-b61f-4c4f-bf49-8883c8aaa908 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:11:59.348284 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-7ba3e2d9-b61f-4c4f-bf49-8883c8aaa908 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.48 "GET /v2.0/networks?id=0890ab9c-2266-4ef4-af73-d3ff421b9bd7 HTTP/1.1" status: 200  len: 811 time: 0.3146031
Jun 01 06:11:59.367366 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-264c630b-3afc-49b6-80ec-83cacf708933 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:59.387598 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-264c630b-3afc-49b6-80ec-83cacf708933 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:59.404859 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:59.410787 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] Attempting to bind port 5a0fb2e6-0298-4b76-b4ad-e89873a54e08 on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:11:59.411596 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] Attempting to bind port 5a0fb2e6-0298-4b76-b4ad-e89873a54e08 by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': '1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 242, 'network_id': '6e45a0e5-f930-4b18-8f4f-1693815eb31a'}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:11:59.412330 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] Attempting to bind port 5a0fb2e6-0298-4b76-b4ad-e89873a54e08 on network 6e45a0e5-f930-4b18-8f4f-1693815eb31a {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:11:59.421553 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 11, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:11:59.422337 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] Checking segment: {'id': '1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 242, 'network_id': '6e45a0e5-f930-4b18-8f4f-1693815eb31a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92231) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:11:59.422986 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:59.423586 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] Bound using segment: {'id': '1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 242, 'network_id': '6e45a0e5-f930-4b18-8f4f-1693815eb31a'} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:11:59.424347 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] Bound port: 5a0fb2e6-0298-4b76-b4ad-e89873a54e08, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 242, 'network_id': '6e45a0e5-f930-4b18-8f4f-1693815eb31a'}}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:11:59.424939 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:59.492833 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=de8f02a4-b74f-47df-a797-bc3cbe7be366,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:59.502853 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:59.510093 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-264c630b-3afc-49b6-80ec-83cacf708933 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4649a9a8-0ec6-404f-8537-61053a2e1b03,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:59.526713 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-ab8ac1b8-424b-480a-86f8-6ec8d6eef2f9 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Unset dirty status for tenant:8f1cf739e243401eb5da7ee705e856de on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:11:59.528540 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-ab8ac1b8-424b-480a-86f8-6ec8d6eef2f9 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=8f1cf739e243401eb5da7ee705e856de&fields=id HTTP/1.1" status: 200  len: 255 time: 1.5022886
Jun 01 06:11:59.542446 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-264c630b-3afc-49b6-80ec-83cacf708933 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=50c300f7d5b04ea8a57614e73f962f19&name=default HTTP/1.1" status: 200  len: 2979 time: 1.0155232
Jun 01 06:11:59.546698 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 59826) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:11:59.551216 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-264c630b-3afc-49b6-80ec-83cacf708933 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:59.559158 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] For port 5a0fb2e6-0298-4b76-b4ad-e89873a54e08, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92231) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:11:59.564602 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] For port 5a0fb2e6-0298-4b76-b4ad-e89873a54e08, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=5a0fb2e6-0298-4b76-b4ad-e89873a54e08,segment=NetworkSegment(1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e),segment_id=1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e)] {{(pid=92231) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:11:59.575030 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-33c1d9c6-7a27-4899-b24a-746a032cc02f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Synchronizing usage tracker for tenant:ac4006667c3442a3910d548e9e9d22c0 on resource:security_group {{(pid=92230) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:11:59.579693 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:59.587480 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:59.613931 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-33c1d9c6-7a27-4899-b24a-746a032cc02f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Unset dirty status for tenant:ac4006667c3442a3910d548e9e9d22c0 on resource:security_group {{(pid=92230) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:11:59.615134 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-33c1d9c6-7a27-4899-b24a-746a032cc02f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.48 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ac4006667c3442a3910d548e9e9d22c0 HTTP/1.1" status: 200  len: 380 time: 0.2460980
Jun 01 06:11:59.650869 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-efcbf011-3aca-4e45-be83-e4d9778aba92 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:59.681577 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] Routers {'ea184dcf-09ad-4302-82aa-16ce19e6c1e5'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:11:59.682213 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2526a90>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:11:43Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['ea184dcf-09ad-4302-82aa-16ce19e6c1e5'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:11:59.707733 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-efcbf011-3aca-4e45-be83-e4d9778aba92 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:59.717956 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-99521f6c-219e-46b1-87aa-fdb190971a1e service neutron] 10.222.0.25 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=segments HTTP/1.1" status: 200  len: 212 time: 1.0167623
Jun 01 06:11:59.763949 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f758f4d-8456-4249-be2d-aa8b090a0a44 None None] Pushing event updated for resources: {'Port': ['ID=5a0fb2e6-0298-4b76-b4ad-e89873a54e08,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:59.769124 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-0f758f4d-8456-4249-be2d-aa8b090a0a44 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:59.807142 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-efcbf011-3aca-4e45-be83-e4d9778aba92 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:59.818423 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-264c630b-3afc-49b6-80ec-83cacf708933 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:11:59.831645 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efcbf011-3aca-4e45-be83-e4d9778aba92 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4649a9a8-0ec6-404f-8537-61053a2e1b03,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:11:59.837008 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-efcbf011-3aca-4e45-be83-e4d9778aba92 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:11:59.839726 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-efcbf011-3aca-4e45-be83-e4d9778aba92 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:11:59.841222 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-efcbf011-3aca-4e45-be83-e4d9778aba92 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/4649a9a8-0ec6-404f-8537-61053a2e1b03 HTTP/1.1" status: 204  len: 168 time: 0.2886362
Jun 01 06:11:59.903182 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b4d36093-60b4-4b23-ab91-cfd9e1719046 req-b33134fb-3e3d-4872-9a09-eee47501641c service neutron] 10.222.0.48 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.8131099
Jun 01 06:11:59.945143 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] Set router ea184dcf-09ad-4302-82aa-16ce19e6c1e5 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:11:59.957261 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-9c63751e-3948-452e-a3b4-34930e9b6cf4 service neutron] 10.222.0.25 "GET /v2.0/networks/6e45a0e5-f930-4b18-8f4f-1693815eb31a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4172702
Jun 01 06:12:00.025806 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-bc708ec3-0732-4999-9b13-8c9b380b7db1 service neutron] 10.222.0.25 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2827873
Jun 01 06:12:00.177565 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-59013b24-d3e0-4392-851f-96347469d4bc service neutron] 10.222.0.25 "GET /v2.0/networks/6e45a0e5-f930-4b18-8f4f-1693815eb31a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2104676
Jun 01 06:12:00.487345 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e1cdb9f3-e7f4-4afb-aaf6-f976b99610d1 req-a5ad6cb9-ea7b-4b61-b4c0-720d5a8ae1d0 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 210 time: 0.0653834
Jun 01 06:12:00.570831 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2526a90>, [{'id': 'ea184dcf-09ad-4302-82aa-16ce19e6c1e5', 'name': 'tempest-ServerRescueNegativeTestJSON-979777158-router', 'tenant_id': '8f1cf739e243401eb5da7ee705e856de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.222'}], 'enable_snat': True}, 'gw_port_id': 'e157eec0-3394-4fbf-8701-c05f500f506a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:51Z', 'revision_number': 4, 'project_id': '8f1cf739e243401eb5da7ee705e856de', 'gw_port': {'id': 'e157eec0-3394-4fbf-8701-c05f500f506a', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:84:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea184dcf-09ad-4302-82aa-16ce19e6c1e5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.222', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:29Z', 'updated_at': '2021-06-01T06:11:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '5a0fb2e6-0298-4b76-b4ad-e89873a54e08', 'name': '', 'network_id': '6e45a0e5-f930-4b18-8f4f-1693815eb31a', 'tenant_id': '8f1cf739e243401eb5da7ee705e856de', 'mac_address': 'fa:16:3e:bf:d7:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea184dcf-09ad-4302-82aa-16ce19e6c1e5', 'device_owner': 'network:router_interface', 'standard_attr_id': 109, 'fixed_ips': [{'subnet_id': '84c296fc-69c0-46e2-b1ed-e3edf435b759', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:47Z', 'updated_at': '2021-06-01T06:11:59Z', 'revision_number': 4, 'project_id': '8f1cf739e243401eb5da7ee705e856de', 'subnets': [{'id': '84c296fc-69c0-46e2-b1ed-e3edf435b759', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:12:00.577258 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69851625-c15a-4ea1-a47d-56a6197740e4 None None] The sync data for ids ['ea184dcf-09ad-4302-82aa-16ce19e6c1e5'] in dv-cinder-793885-1-iscsi is: [{'id': 'ea184dcf-09ad-4302-82aa-16ce19e6c1e5', 'name': 'tempest-ServerRescueNegativeTestJSON-979777158-router', 'tenant_id': '8f1cf739e243401eb5da7ee705e856de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.222'}], 'enable_snat': True}, 'gw_port_id': 'e157eec0-3394-4fbf-8701-c05f500f506a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:51Z', 'revision_number': 4, 'project_id': '8f1cf739e243401eb5da7ee705e856de', 'gw_port': {'id': 'e157eec0-3394-4fbf-8701-c05f500f506a', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:84:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea184dcf-09ad-4302-82aa-16ce19e6c1e5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.222', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:29Z', 'updated_at': '2021-06-01T06:11:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '5a0fb2e6-0298-4b76-b4ad-e89873a54e08', 'name': '', 'network_id': '6e45a0e5-f930-4b18-8f4f-1693815eb31a', 'tenant_id': '8f1cf739e243401eb5da7ee705e856de', 'mac_address': 'fa:16:3e:bf:d7:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea184dcf-09ad-4302-82aa-16ce19e6c1e5', 'device_owner': 'network:router_interface', 'standard_attr_id': 109, 'fixed_ips': [{'subnet_id': '84c296fc-69c0-46e2-b1ed-e3edf435b759', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:47Z', 'updated_at': '2021-06-01T06:11:59Z', 'revision_number': 4, 'project_id': '8f1cf739e243401eb5da7ee705e856de', 'subnets': [{'id': '84c296fc-69c0-46e2-b1ed-e3edf435b759', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:12:00.943795 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ab01743-4f15-44cb-a8c1-3eba3fe36e70 req-d03a91c9-3d9f-4b0b-95fb-520a27effab7 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:00.945347 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3ab01743-4f15-44cb-a8c1-3eba3fe36e70 req-d03a91c9-3d9f-4b0b-95fb-520a27effab7 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 944 time: 0.2436264
Jun 01 06:12:01.016622 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a9e0418-05c4-4b0b-a22f-0ea47afc9021 req-cd5291f9-66d6-4b34-993b-5dd36bf17f6d tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:01.020792 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2a9e0418-05c4-4b0b-a22f-0ea47afc9021 req-cd5291f9-66d6-4b34-993b-5dd36bf17f6d tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/ports?device_id=b662816d-f3d5-434d-b2c3-eb501ac85556 HTTP/1.1" status: 200  len: 946 time: 0.2554185
Jun 01 06:12:01.144382 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3ab01743-4f15-44cb-a8c1-3eba3fe36e70 req-b0d409ff-685e-4cde-96e4-d92cdb814430 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1907015
Jun 01 06:12:01.162442 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2a9e0418-05c4-4b0b-a22f-0ea47afc9021 req-032f49fa-ee98-45d3-9cb1-eda54004cc36 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/security-groups?id=322d6e24-5243-409c-8b80-acbe06176a3c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1305940
Jun 01 06:12:01.410498 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-97c25f32-ceec-4f48-8903-40c8840d340e req-daa80053-3ab5-44b5-b2fd-1cf8c9f61e77 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 210 time: 0.1064169
Jun 01 06:12:01.420499 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ee26cf6c-b47f-471e-ba51-c8c0a70e8892 req-e75baea0-6d55-421e-996d-0858080f26ac tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 210 time: 0.0850797
Jun 01 06:12:01.687037 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ee0f3464-5629-42d5-8ed5-10ef21007f8f req-64944597-f87b-4a30-b9bc-86dcd29b3580 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 210 time: 0.0616119
Jun 01 06:12:02.028881 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-504da88c-0f88-4e6b-9477-8ac5f691598c tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:02.030970 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-504da88c-0f88-4e6b-9477-8ac5f691598c tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/networks?id=6e45a0e5-f930-4b18-8f4f-1693815eb31a HTTP/1.1" status: 200  len: 818 time: 0.2485406
Jun 01 06:12:02.054660 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-64cb8d55-656c-4841-9dd0-9f51da94af7d tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/quotas/8f1cf739e243401eb5da7ee705e856de HTTP/1.1" status: 200  len: 375 time: 0.0132513
Jun 01 06:12:02.121894 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 5a0fb2e6-0298-4b76-b4ad-e89873a54e08 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:12:02.178279 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-5ffbd729-ac51-40e2-9ee1-9a575e49d88d tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=8f1cf739e243401eb5da7ee705e856de&fields=id HTTP/1.1" status: 200  len: 255 time: 0.1096022
Jun 01 06:12:02.235924 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port 5a0fb2e6-0298-4b76-b4ad-e89873a54e08 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:12:02.249160 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 5a0fb2e6-0298-4b76-b4ad-e89873a54e08 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:12:02.249544 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:02.408486 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-7f0568a1-8800-4750-88cd-809bf7dc1d60 service neutron] 10.222.0.25 "GET /v2.0/networks/6e45a0e5-f930-4b18-8f4f-1693815eb31a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2186229
Jun 01 06:12:02.420372 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:02.432306 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-69b3bdb6-a68e-412f-ac99-3cdbaab5bcd2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Request body: {'port': {'device_id': 'eb18f959-9e44-4148-a4fe-8f878905f76b', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'admin_state_up': True, 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'security_groups': ['932cfb13-85ed-405d-8a3d-cd7d8f3bab94']}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:12:02.531427 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port 5a0fb2e6-0298-4b76-b4ad-e89873a54e08, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=5a0fb2e6-0298-4b76-b4ad-e89873a54e08,segment=NetworkSegment(1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e),segment_id=1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:12:02.545972 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['de8f02a4-b74f-47df-a797-bc3cbe7be366'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:12:02.616911 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:02.633597 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:02.742346 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-69b3bdb6-a68e-412f-ac99-3cdbaab5bcd2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:02.748677 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-69b3bdb6-a68e-412f-ac99-3cdbaab5bcd2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Usage tracker for resource:port and tenant:ac4006667c3442a3910d548e9e9d22c0 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:02.751729 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=5a0fb2e6-0298-4b76-b4ad-e89873a54e08,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:02.751987 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-69b3bdb6-a68e-412f-ac99-3cdbaab5bcd2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Quota usage for port was recalculated. Used quota:3. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:02.759472 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-69b3bdb6-a68e-412f-ac99-3cdbaab5bcd2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:02.766348 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:02.778762 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-69b3bdb6-a68e-412f-ac99-3cdbaab5bcd2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Made reservation on behalf of ac4006667c3442a3910d548e9e9d22c0 for: {'port': 1} {{(pid=92230) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:12:02.782938 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-69b3bdb6-a68e-412f-ac99-3cdbaab5bcd2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:02.800306 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 59956) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:02.955212 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a87096f5-bd23-42ac-a4e0-aae385570452 req-9b1bc483-0062-4509-b45a-857945c2e1c6 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:02.957929 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a87096f5-bd23-42ac-a4e0-aae385570452 req-9b1bc483-0062-4509-b45a-857945c2e1c6 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 944 time: 0.6556680
Jun 01 06:12:03.020620 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-329cb82d-5310-43c7-a027-f4d1d0cfb882 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:03.073419 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-329cb82d-5310-43c7-a027-f4d1d0cfb882 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:03.082562 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a87096f5-bd23-42ac-a4e0-aae385570452 req-ec06c070-e8c5-4a6b-bd74-b43582c7e773 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1101308
Jun 01 06:12:03.085506 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-329cb82d-5310-43c7-a027-f4d1d0cfb882 admin admin] Usage tracker for resource:security_group_rule and tenant:b803a090bf9a41aba1ea66bff4545fd0 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:03.093187 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-8baa725a-1626-45c9-916f-a335fae892c6 service neutron] 10.222.0.25 "GET /v2.0/networks/6e45a0e5-f930-4b18-8f4f-1693815eb31a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6756978
Jun 01 06:12:03.097073 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-329cb82d-5310-43c7-a027-f4d1d0cfb882 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:03.097196 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b4d36093-60b4-4b23-ab91-cfd9e1719046 req-0af84c1e-d243-4ffd-b66a-d818a66dae02 service neutron] 10.222.0.48 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4668500
Jun 01 06:12:03.131106 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-329cb82d-5310-43c7-a027-f4d1d0cfb882 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:03.259763 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_common [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-69b3bdb6-a68e-412f-ac99-3cdbaab5bcd2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Allocated IP 172.20.0.4 (0890ab9c-2266-4ef4-af73-d3ff421b9bd7/3e980239-de35-45a0-8039-8395b5408617/42597738-974b-4af6-a799-e37d02b057b9) {{(pid=92230) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:12:03.424112 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21121a4c-97a8-4d45-905f-f5c46e0bf268 req-4b211535-bed6-4dbe-a64a-54f27bf0a300 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:03.435336 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-21121a4c-97a8-4d45-905f-f5c46e0bf268 req-4b211535-bed6-4dbe-a64a-54f27bf0a300 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/ports?device_id=b662816d-f3d5-434d-b2c3-eb501ac85556 HTTP/1.1" status: 200  len: 946 time: 0.1379561
Jun 01 06:12:03.584899 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f104c25d-a7c5-4448-9f6a-51573dfbbd49 req-767e64d9-78bf-4546-9c95-3b9425d66b52 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 210 time: 0.1467931
Jun 01 06:12:03.698534 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device de8f02a4-b74f-47df-a797-bc3cbe7be366 up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:12:03.785878 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-69b3bdb6-a68e-412f-ac99-3cdbaab5bcd2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for port, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:03.811859 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-329cb82d-5310-43c7-a027-f4d1d0cfb882 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:03.822775 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-329cb82d-5310-43c7-a027-f4d1d0cfb882 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:03.825515 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.provisioning_blocks [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-69b3bdb6-a68e-412f-ac99-3cdbaab5bcd2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Transition to ACTIVE for port object 42597738-974b-4af6-a799-e37d02b057b9 will not be triggered until provisioned by entity DHCP. {{(pid=92230) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:12:03.859504 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-efcbf011-3aca-4e45-be83-e4d9778aba92 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:03.955246 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning for port de8f02a4-b74f-47df-a797-bc3cbe7be366 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:12:03.969793 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port de8f02a4-b74f-47df-a797-bc3cbe7be366 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:12:03.971557 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:03.997964 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-69b3bdb6-a68e-412f-ac99-3cdbaab5bcd2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:04.128263 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-21121a4c-97a8-4d45-905f-f5c46e0bf268 req-559be30b-51ac-42bc-95d0-3d764acfa51e tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/security-groups?id=322d6e24-5243-409c-8b80-acbe06176a3c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.6915097
Jun 01 06:12:04.148915 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-69b3bdb6-a68e-412f-ac99-3cdbaab5bcd2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Network 0890ab9c-2266-4ef4-af73-d3ff421b9bd7 is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:12:04.150097 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-329cb82d-5310-43c7-a027-f4d1d0cfb882 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=864887da-f324-46c4-b47e-438fbbe55a78,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:04.159344 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.48', 58109) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:04.163975 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-329cb82d-5310-43c7-a027-f4d1d0cfb882 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.302s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:04.176709 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-329cb82d-5310-43c7-a027-f4d1d0cfb882 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=b803a090bf9a41aba1ea66bff4545fd0&name=default HTTP/1.1" status: 200  len: 2979 time: 1.3748503
Jun 01 06:12:04.177809 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 60004) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:04.182741 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-69b3bdb6-a68e-412f-ac99-3cdbaab5bcd2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:12:04.203026 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-69b3bdb6-a68e-412f-ac99-3cdbaab5bcd2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Received port after_create {{(pid=92230) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:12:04.230923 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-69b3bdb6-a68e-412f-ac99-3cdbaab5bcd2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:04.232620 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-69b3bdb6-a68e-412f-ac99-3cdbaab5bcd2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for port, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:04.243236 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.109s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:04.314162 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:04.328205 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 5a0fb2e6-0298-4b76-b4ad-e89873a54e08 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:12:04.499091 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69b3bdb6-a68e-412f-ac99-3cdbaab5bcd2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Pushing event updated for resources: {'Port': ['ID=42597738-974b-4af6-a799-e37d02b057b9,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:04.562963 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port de8f02a4-b74f-47df-a797-bc3cbe7be366, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=de8f02a4-b74f-47df-a797-bc3cbe7be366,segment=NetworkSegment(7e12089c-d8cc-429c-8b7b-f5d148a55957),segment_id=7e12089c-d8cc-429c-8b7b-f5d148a55957)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:12:04.564671 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5967d75f-2870-4a80-98ec-b2547cff266e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'de8f02a4-b74f-47df-a797-bc3cbe7be366'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:12:04.569704 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0e67807e-b0bf-4362-b172-521a5a716f67" -d '{"events": [{"server_uuid": "5967d75f-2870-4a80-98ec-b2547cff266e", "name": "network-vif-plugged", "status": "completed", "tag": "de8f02a4-b74f-47df-a797-bc3cbe7be366"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:12:04.593387 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:04.596548 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 5a0fb2e6-0298-4b76-b4ad-e89873a54e08 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:12:04.597182 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:04.649389 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-69b3bdb6-a68e-412f-ac99-3cdbaab5bcd2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.406s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:04.651618 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-17166458-f5b9-4291-a5a6-b1e8b7d59012 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:04.684269 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6d0e1df9-9f94-4bfa-bf97-05bbe3f3eea4 req-dfe9152e-a9db-4425-8f1f-b33da61d0e1d tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 210 time: 0.4049935
Jun 01 06:12:04.724870 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-69b3bdb6-a68e-412f-ac99-3cdbaab5bcd2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.3001416
Jun 01 06:12:04.737205 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e348349d-8b42-4700-a340-f81dc2c88432 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:04.744429 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Request body: {'port': {'device_id': 'eb18f959-9e44-4148-a4fe-8f878905f76b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79388'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:12:04.861179 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e348349d-8b42-4700-a340-f81dc2c88432 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:04.924021 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-5574df62-1937-44de-94ac-53ccde0cac00 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:04.934485 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-5574df62-1937-44de-94ac-53ccde0cac00 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.48 "GET /v2.0/networks?id=6e45a0e5-f930-4b18-8f4f-1693815eb31a HTTP/1.1" status: 200  len: 818 time: 1.4924476
Jun 01 06:12:04.964772 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-ceb82961-3485-4405-8665-22daae88544a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Request body: {'port': {'device_id': 'dc8bf0a9-503e-487c-975a-ec720e525cf1', 'network_id': '6e45a0e5-f930-4b18-8f4f-1693815eb31a', 'admin_state_up': True, 'tenant_id': '8f1cf739e243401eb5da7ee705e856de'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:12:05.006334 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d35c3342-9e29-4de7-a36b-b37009ff251d None None] Provisioning for port 42597738-974b-4af6-a799-e37d02b057b9 completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:12:05.037230 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=de8f02a4-b74f-47df-a797-bc3cbe7be366,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:05.051646 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d35c3342-9e29-4de7-a36b-b37009ff251d None None] Provisioning complete for port 42597738-974b-4af6-a799-e37d02b057b9 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:12:05.052079 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d35c3342-9e29-4de7-a36b-b37009ff251d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:05.061806 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:05.120681 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.468s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:05.253280 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e348349d-8b42-4700-a340-f81dc2c88432 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:05.268503 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-15023012-433c-49fa-854d-01e8b7322535 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:05.294093 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e348349d-8b42-4700-a340-f81dc2c88432 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=864887da-f324-46c4-b47e-438fbbe55a78,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:05.306776 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-d35c3342-9e29-4de7-a36b-b37009ff251d None None] Port 42597738-974b-4af6-a799-e37d02b057b9 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:12:05.317037 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e348349d-8b42-4700-a340-f81dc2c88432 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:05.317037 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e348349d-8b42-4700-a340-f81dc2c88432 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:05.323346 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-e348349d-8b42-4700-a340-f81dc2c88432 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/864887da-f324-46c4-b47e-438fbbe55a78 HTTP/1.1" status: 204  len: 168 time: 0.8349774
Jun 01 06:12:05.355975 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-390f30b9-0232-48a6-9fff-967e19a8852e req-2f0cc96d-0e38-4752-81b1-09ec68fbe6ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:05.375373 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-390f30b9-0232-48a6-9fff-967e19a8852e req-2f0cc96d-0e38-4752-81b1-09ec68fbe6ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 931 time: 1.4760258
Jun 01 06:12:05.472987 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-06bd5577-d97d-46bb-a424-a9f50a2eff34 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:05.474473 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-06bd5577-d97d-46bb-a424-a9f50a2eff34 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.48 "GET /v2.0/networks?id=5f973ed4-521b-4b78-9a54-1336b1302fa2 HTTP/1.1" status: 200  len: 816 time: 1.3128622
Jun 01 06:12:05.603313 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-59eebad3-4b81-4360-a583-f0b17dbfda43 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.48 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=0f63ca6fed3e47a6a676979240aef5c0 HTTP/1.1" status: 200  len: 379 time: 0.1130111
Jun 01 06:12:05.630106 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.48', 58116) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:05.649327 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-390f30b9-0232-48a6-9fff-967e19a8852e req-67011e84-0b72-4719-84aa-28384d1f08c0 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2426465
Jun 01 06:12:05.706986 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-dda4501d-a333-462a-93c2-2256d43e1590 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Request body: {'port': {'device_id': '1385f5c8-2a7a-45b1-a982-6f897700aa17', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'admin_state_up': True, 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'security_groups': ['d244799f-12ae-4ce0-9252-891377721dbc']}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:12:05.838081 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:12:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cc484a9e-6281-4f6e-be32-4a647655a872 x-openstack-request-id: req-cc484a9e-6281-4f6e-be32-4a647655a872 {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:12:05.838314 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5967d75f-2870-4a80-98ec-b2547cff266e", "name": "network-vif-plugged", "status": "completed", "tag": "de8f02a4-b74f-47df-a797-bc3cbe7be366", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:12:05.839225 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-cc484a9e-6281-4f6e-be32-4a647655a872 {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:12:05.841176 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5967d75f-2870-4a80-98ec-b2547cff266e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'de8f02a4-b74f-47df-a797-bc3cbe7be366', 'code': 200}
Jun 01 06:12:06.121838 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-ceb82961-3485-4405-8665-22daae88544a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:06.153907 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-bdf6b2d5-9d0f-4fe8-8217-4e5ea1f211ac tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:06.157479 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-bdf6b2d5-9d0f-4fe8-8217-4e5ea1f211ac tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.48 "GET /v2.0/networks?id=6e45a0e5-f930-4b18-8f4f-1693815eb31a HTTP/1.1" status: 200  len: 818 time: 0.5255563
Jun 01 06:12:06.228354 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4799024-ec7d-4e7b-affe-931404e0322a req-e99ad784-6c40-422d-88b4-407d1bc2692b tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:06.242277 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b4799024-ec7d-4e7b-affe-931404e0322a req-e99ad784-6c40-422d-88b4-407d1bc2692b tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 945 time: 1.2400813
Jun 01 06:12:06.246101 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-77a59393-30ca-49b8-8c25-e7b81fcb9339 req-ab8d69f2-22cf-4b5e-8103-9fed34c475b5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 210 time: 0.2257440
Jun 01 06:12:06.258758 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.notifiers.nova [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 42597738-974b-4af6-a799-e37d02b057b9 {{(pid=92230) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:12:06.265732 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-ceb82961-3485-4405-8665-22daae88544a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:06.268713 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:06.287493 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.provisioning_blocks [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Transition to ACTIVE for port object 42597738-974b-4af6-a799-e37d02b057b9 will not be triggered until provisioned by entity L2. {{(pid=92230) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:12:06.300342 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-dda4501d-a333-462a-93c2-2256d43e1590 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:06.311285 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:06.315592 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-dda4501d-a333-462a-93c2-2256d43e1590 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:06.326565 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-f2d956dd-e0a1-4083-bdb2-e8a0e289e16a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:06.327619 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-ceb82961-3485-4405-8665-22daae88544a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Made reservation on behalf of 8f1cf739e243401eb5da7ee705e856de for: {'port': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:12:06.332918 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-ceb82961-3485-4405-8665-22daae88544a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:06.368874 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-dda4501d-a333-462a-93c2-2256d43e1590 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Made reservation on behalf of 0f63ca6fed3e47a6a676979240aef5c0 for: {'port': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:12:06.368874 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-dda4501d-a333-462a-93c2-2256d43e1590 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:06.674675 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b4799024-ec7d-4e7b-affe-931404e0322a req-7231b6ae-f1a9-4d7f-ae18-869f881945e3 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4313383
Jun 01 06:12:06.680037 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-200a95b8-e39a-47ce-8fc7-a08e072362a4 req-7b5d6f44-ed1b-4ba1-b229-9cf371f364dd tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 210 time: 0.1728780
Jun 01 06:12:06.694173 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Pushing event updated for resources: {'Port': ['ID=42597738-974b-4af6-a799-e37d02b057b9,revision_number=2']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:06.704031 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.380s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:06.726739 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:12:06.753587 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.managers [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Attempting to bind port 42597738-974b-4af6-a799-e37d02b057b9 on host hv-cinder-79388 for vnic_type normal with profile  {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:12:06.753975 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.managers [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Attempting to bind port 42597738-974b-4af6-a799-e37d02b057b9 by drivers openvswitch,hyperv on host hv-cinder-79388 at level 0 using segments [{'id': '5dda6d07-db2a-40a3-815e-42df1528c630', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 224, 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7'}] {{(pid=92230) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:12:06.754310 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Attempting to bind port 42597738-974b-4af6-a799-e37d02b057b9 on network 0890ab9c-2266-4ef4-af73-d3ff421b9bd7 {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:12:06.767811 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Port 42597738-974b-4af6-a799-e37d02b057b9 on network 0890ab9c-2266-4ef4-af73-d3ff421b9bd7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79388 {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 06:12:06.768133 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Attempting to bind port 42597738-974b-4af6-a799-e37d02b057b9 on network 0890ab9c-2266-4ef4-af73-d3ff421b9bd7 {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:12:06.786639 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Checking agent: {'id': '56148394-2131-4d06-bcfa-c032301591b8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79388', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'started_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 11, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:12:06.787054 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Checking segment: {'id': '5dda6d07-db2a-40a3-815e-42df1528c630', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 224, 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92230) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:12:06.787502 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Bound using segment: {'id': '5dda6d07-db2a-40a3-815e-42df1528c630', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 224, 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7'} {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:12:06.788017 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.managers [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Bound port: 42597738-974b-4af6-a799-e37d02b057b9, host: hv-cinder-79388, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5dda6d07-db2a-40a3-815e-42df1528c630', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 224, 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7'}}] {{(pid=92230) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:12:06.788423 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:06.824818 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-ceb82961-3485-4405-8665-22daae88544a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Allocated IP 172.20.0.4 (6e45a0e5-f930-4b18-8f4f-1693815eb31a/84c296fc-69c0-46e2-b1ed-e3edf435b759/5f320f89-ada2-472d-b9ac-0676b4c4b578) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:12:06.926351 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] For port 42597738-974b-4af6-a799-e37d02b057b9, host hv-cinder-79388, cleared binding levels {{(pid=92230) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:12:06.931433 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] For port 42597738-974b-4af6-a799-e37d02b057b9, host hv-cinder-79388, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=42597738-974b-4af6-a799-e37d02b057b9,segment=NetworkSegment(5dda6d07-db2a-40a3-815e-42df1528c630),segment_id=5dda6d07-db2a-40a3-815e-42df1528c630)] {{(pid=92230) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:12:06.938997 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:06.946425 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:07.029790 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:07.033295 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for port, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:07.035178 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] 10.222.0.48 "PUT /v2.0/ports/42597738-974b-4af6-a799-e37d02b057b9 HTTP/1.1" status: 200  len: 1093 time: 2.2992826
Jun 01 06:12:07.052468 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'eb18f959-9e44-4148-a4fe-8f878905f76b', 'tag': '42597738-974b-4af6-a799-e37d02b057b9'}] {{(pid=92230) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:12:07.054784 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a8971187fdc179bafebfda031591b22633150c3ea1d9449252a7819502f19756" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-274370d6-9b23-40ad-8389-1da77ce776ce" -d '{"events": [{"name": "network-changed", "server_uuid": "eb18f959-9e44-4148-a4fe-8f878905f76b", "tag": "42597738-974b-4af6-a799-e37d02b057b9"}]}' {{(pid=92230) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:12:07.082656 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Pushing event updated for resources: {'Port': ['ID=42597738-974b-4af6-a799-e37d02b057b9,revision_number=3']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:07.086184 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:07.258432 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 60108) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:07.321261 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-dda4501d-a333-462a-93c2-2256d43e1590 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Allocated IP 172.20.0.4 (5f973ed4-521b-4b78-9a54-1336b1302fa2/6137ee10-ce13-45c9-8edb-31811502bfd7/826848c6-a93a-4712-82dd-39e403bcb79e) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:12:07.344039 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b4c70b1-8aef-4b5a-aa41-2285967156c3 req-3e4ce699-87f8-4e31-812c-5d14dda0fcd7 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:07.348468 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5b4c70b1-8aef-4b5a-aa41-2285967156c3 req-3e4ce699-87f8-4e31-812c-5d14dda0fcd7 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 943 time: 0.4793272
Jun 01 06:12:07.414311 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-fbb7642f-091b-4c16-9611-78be61f7d0df admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:07.429973 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-fbb7642f-091b-4c16-9611-78be61f7d0df admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:07.435460 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-fbb7642f-091b-4c16-9611-78be61f7d0df admin admin] Usage tracker for resource:security_group_rule and tenant:06ca9bb081544942851074034c57b586 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:07.438513 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-fbb7642f-091b-4c16-9611-78be61f7d0df admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:07.446452 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-fbb7642f-091b-4c16-9611-78be61f7d0df admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:07.490208 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-ceb82961-3485-4405-8665-22daae88544a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:07.500817 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5b4c70b1-8aef-4b5a-aa41-2285967156c3 req-aa81873b-7535-4a3c-9b16-b6b48b08bddd tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1379762
Jun 01 06:12:07.552738 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-fbb7642f-091b-4c16-9611-78be61f7d0df admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:07.560314 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-fbb7642f-091b-4c16-9611-78be61f7d0df admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:07.575283 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-f30451cd-526e-481a-995a-a414f1fdda13 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:07.588207 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:12:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-041d3da3-79ea-469e-8779-543928e6dfb9 x-openstack-request-id: req-041d3da3-79ea-469e-8779-543928e6dfb9 {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:12:07.588538 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "eb18f959-9e44-4148-a4fe-8f878905f76b", "tag": "42597738-974b-4af6-a799-e37d02b057b9", "status": "completed", "code": 200}]} {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:12:07.588778 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-041d3da3-79ea-469e-8779-543928e6dfb9 {{(pid=92230) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:12:07.589180 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'eb18f959-9e44-4148-a4fe-8f878905f76b', 'tag': '42597738-974b-4af6-a799-e37d02b057b9', 'status': 'completed', 'code': 200}
Jun 01 06:12:07.633783 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbb7642f-091b-4c16-9611-78be61f7d0df admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d7c0af44-348f-49bd-bf54-a49435b6a4cf,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:07.639003 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-fbb7642f-091b-4c16-9611-78be61f7d0df admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=06ca9bb081544942851074034c57b586&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3793204
Jun 01 06:12:07.648519 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-fbb7642f-091b-4c16-9611-78be61f7d0df admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:07.648796 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 60126) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:07.680839 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-ceb82961-3485-4405-8665-22daae88544a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:07.718507 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-02682992-69fa-4c03-bdab-910390ddd1d3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:07.750492 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-02682992-69fa-4c03-bdab-910390ddd1d3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:07.762801 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:07.824338 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-02682992-69fa-4c03-bdab-910390ddd1d3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:07.826496 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d2c1bc34-389f-475f-954f-ec5df0d916f4 req-6a61f696-e0b9-4dae-9362-fbd909a020f3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 210 time: 0.1404765
Jun 01 06:12:07.829216 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-a4e99c22-44fe-4481-8320-641391afa6e5 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:07.844458 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02682992-69fa-4c03-bdab-910390ddd1d3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d7c0af44-348f-49bd-bf54-a49435b6a4cf,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:07.847942 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-02682992-69fa-4c03-bdab-910390ddd1d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:07.852383 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-ceb82961-3485-4405-8665-22daae88544a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Network 6e45a0e5-f930-4b18-8f4f-1693815eb31a is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:12:07.857653 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-ceb82961-3485-4405-8665-22daae88544a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:12:07.872113 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-02682992-69fa-4c03-bdab-910390ddd1d3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:07.872113 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-02682992-69fa-4c03-bdab-910390ddd1d3 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/d7c0af44-348f-49bd-bf54-a49435b6a4cf HTTP/1.1" status: 204  len: 168 time: 0.2207086
Jun 01 06:12:07.888218 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-dda4501d-a333-462a-93c2-2256d43e1590 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:07.908883 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-dda4501d-a333-462a-93c2-2256d43e1590 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Transition to ACTIVE for port object 826848c6-a93a-4712-82dd-39e403bcb79e will not be triggered until provisioned by entity DHCP. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:12:07.922260 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-ceb82961-3485-4405-8665-22daae88544a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:12:07.929586 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-ceb82961-3485-4405-8665-22daae88544a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:07.930253 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-ceb82961-3485-4405-8665-22daae88544a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:07.972119 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-ceb82961-3485-4405-8665-22daae88544a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 3.0249069
Jun 01 06:12:08.014411 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb82961-3485-4405-8665-22daae88544a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Pushing event updated for resources: {'Port': ['ID=5f320f89-ada2-472d-b9ac-0676b4c4b578,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:08.017842 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ceb82961-3485-4405-8665-22daae88544a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.255s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:08.048345 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-dda4501d-a333-462a-93c2-2256d43e1590 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:08.058807 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:08.144893 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-dda4501d-a333-462a-93c2-2256d43e1590 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Network 5f973ed4-521b-4b78-9a54-1336b1302fa2 is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:12:08.149261 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-dda4501d-a333-462a-93c2-2256d43e1590 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:12:08.158059 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-dda4501d-a333-462a-93c2-2256d43e1590 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:12:08.163998 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-dda4501d-a333-462a-93c2-2256d43e1590 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:08.164580 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-dda4501d-a333-462a-93c2-2256d43e1590 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:08.169420 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dda4501d-a333-462a-93c2-2256d43e1590 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Pushing event updated for resources: {'Port': ['ID=826848c6-a93a-4712-82dd-39e403bcb79e,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:08.181222 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07798479-8591-4b5e-b1ee-29f2faef1cf7 req-d37e13a5-efb2-4cdd-be33-c9edc304bc7c tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:08.182815 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-07798479-8591-4b5e-b1ee-29f2faef1cf7 req-d37e13a5-efb2-4cdd-be33-c9edc304bc7c tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 945 time: 0.2222989
Jun 01 06:12:08.196727 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-dda4501d-a333-462a-93c2-2256d43e1590 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:08.229244 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-dda4501d-a333-462a-93c2-2256d43e1590 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.5475609
Jun 01 06:12:08.264679 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-07798479-8591-4b5e-b1ee-29f2faef1cf7 req-5e5dc11d-7bf3-42a2-9a1a-71f094f86a9d tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0513444
Jun 01 06:12:08.342051 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-ddd50711-d8d2-4b6f-8564-e3ab36c5b7f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:08.422014 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-2a24275c-ebee-40d6-ac37-7247c30eceb0 None None] Provisioning for port 826848c6-a93a-4712-82dd-39e403bcb79e completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:12:08.428644 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-2a24275c-ebee-40d6-ac37-7247c30eceb0 None None] Provisioning complete for port 826848c6-a93a-4712-82dd-39e403bcb79e triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:12:08.428845 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-2a24275c-ebee-40d6-ac37-7247c30eceb0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:08.465445 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-d6b5a534-ab8d-4d1a-9856-ccda5a5ab979 req-b5ad0e73-3c3b-4f13-bf10-dcbf5560bf47 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Synchronizing usage tracker for tenant:8f1cf739e243401eb5da7ee705e856de on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:12:08.485911 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-d6b5a534-ab8d-4d1a-9856-ccda5a5ab979 req-b5ad0e73-3c3b-4f13-bf10-dcbf5560bf47 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Unset dirty status for tenant:8f1cf739e243401eb5da7ee705e856de on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:12:08.488163 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d6b5a534-ab8d-4d1a-9856-ccda5a5ab979 req-b5ad0e73-3c3b-4f13-bf10-dcbf5560bf47 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 210 time: 0.0778670
Jun 01 06:12:08.491720 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-2a24275c-ebee-40d6-ac37-7247c30eceb0 None None] Port 826848c6-a93a-4712-82dd-39e403bcb79e cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:12:08.506683 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 60166) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:08.528369 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-020d37d5-ab99-46ad-805b-8fe3a5c81db7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:08.545299 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-020d37d5-ab99-46ad-805b-8fe3a5c81db7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:08.549316 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-020d37d5-ab99-46ad-805b-8fe3a5c81db7 admin admin] Usage tracker for resource:security_group_rule and tenant:3dfd06c61d8146d28a21e597b6a9a7f1 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:08.552250 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-020d37d5-ab99-46ad-805b-8fe3a5c81db7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:08.559203 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-020d37d5-ab99-46ad-805b-8fe3a5c81db7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:08.610443 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 60172) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:08.665917 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-020d37d5-ab99-46ad-805b-8fe3a5c81db7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:08.672391 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-020d37d5-ab99-46ad-805b-8fe3a5c81db7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:08.694884 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:08.704215 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c29f16f-477f-4316-b2cf-805c00869c41 req-9b394c27-a571-4ced-909a-4088b22258e9 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:08.706341 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1c29f16f-477f-4316-b2cf-805c00869c41 req-9b394c27-a571-4ced-909a-4088b22258e9 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 943 time: 0.0926070
Jun 01 06:12:08.740474 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-020d37d5-ab99-46ad-805b-8fe3a5c81db7 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=3dfd06c61d8146d28a21e597b6a9a7f1&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2320888
Jun 01 06:12:08.741747 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 60180) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:08.742602 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-020d37d5-ab99-46ad-805b-8fe3a5c81db7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ba8afff6-fc0d-46f5-b9b9-aa17904b3040,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:08.745750 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-020d37d5-ab99-46ad-805b-8fe3a5c81db7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:08.795915 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1c29f16f-477f-4316-b2cf-805c00869c41 req-1e88dd7b-1807-49b2-8749-47008c5b51fe tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0710742
Jun 01 06:12:08.832673 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-9e52c4f3-4cc9-4595-8332-066f7d0fbf50 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:08.852936 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-4f85d918-780f-46cd-ba81-f3b4f6d4d2d2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Request body: {'port': {'device_id': '72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a', 'network_id': '6e45a0e5-f930-4b18-8f4f-1693815eb31a', 'admin_state_up': True, 'tenant_id': '8f1cf739e243401eb5da7ee705e856de'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:12:08.891637 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-9e52c4f3-4cc9-4595-8332-066f7d0fbf50 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:08.901535 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Request body: {'port': {'device_id': 'dc8bf0a9-503e-487c-975a-ec720e525cf1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79388'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:12:08.936091 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Request body: {'port': {'device_id': '1385f5c8-2a7a-45b1-a982-6f897700aa17', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79388'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:12:08.973518 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ade666c6-da86-4184-b145-53070a765925 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:09.084254 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.48', 58121) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:09.109237 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-ade666c6-da86-4184-b145-53070a765925 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:09.168128 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-ade666c6-da86-4184-b145-53070a765925 admin admin] Usage tracker for resource:security_group_rule and tenant:3dec26e8e0e34f818f4870fd41cfdfb7 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:09.176194 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-4f85d918-780f-46cd-ba81-f3b4f6d4d2d2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:09.178941 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-ade666c6-da86-4184-b145-53070a765925 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:09.194422 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-4f85d918-780f-46cd-ba81-f3b4f6d4d2d2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:09.201774 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-ade666c6-da86-4184-b145-53070a765925 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:09.210710 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-274370d6-9b23-40ad-8389-1da77ce776ce req-7277301b-0205-4c93-9236-acbf822665a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:09.213691 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-274370d6-9b23-40ad-8389-1da77ce776ce req-7277301b-0205-4c93-9236-acbf822665a6 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=ac4006667c3442a3910d548e9e9d22c0&device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 1096 time: 0.2252336
Jun 01 06:12:09.215770 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-4f85d918-780f-46cd-ba81-f3b4f6d4d2d2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Made reservation on behalf of 8f1cf739e243401eb5da7ee705e856de for: {'port': 1} {{(pid=92230) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:12:09.220192 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-4f85d918-780f-46cd-ba81-f3b4f6d4d2d2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:09.335885 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:09.429575 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-9e52c4f3-4cc9-4595-8332-066f7d0fbf50 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:09.486227 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-274370d6-9b23-40ad-8389-1da77ce776ce req-42ff9391-3029-4d82-8911-c2f7bc4fbd6b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:09.487588 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-274370d6-9b23-40ad-8389-1da77ce776ce req-42ff9391-3029-4d82-8911-c2f7bc4fbd6b service neutron] 10.222.0.48 "GET /v2.0/networks?tenant_id=ac4006667c3442a3910d548e9e9d22c0&shared=False HTTP/1.1" status: 200  len: 912 time: 0.2566600
Jun 01 06:12:09.531832 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-edbc8b1e-e059-493e-8527-2c4512646d95 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:09.565842 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:09.591392 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e52c4f3-4cc9-4595-8332-066f7d0fbf50 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ba8afff6-fc0d-46f5-b9b9-aa17904b3040,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:09.601999 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-9e52c4f3-4cc9-4595-8332-066f7d0fbf50 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:09.611948 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_common [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-4f85d918-780f-46cd-ba81-f3b4f6d4d2d2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Allocated IP 172.20.0.3 (6e45a0e5-f930-4b18-8f4f-1693815eb31a/84c296fc-69c0-46e2-b1ed-e3edf435b759/6596ca76-68f1-4ba1-ad74-a27f199ef442) {{(pid=92230) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:12:09.686793 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-274370d6-9b23-40ad-8389-1da77ce776ce req-1bb497fe-d925-4761-bbca-a37f52b9bd36 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:09.688315 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-274370d6-9b23-40ad-8389-1da77ce776ce req-1bb497fe-d925-4761-bbca-a37f52b9bd36 service neutron] 10.222.0.48 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1933997
Jun 01 06:12:09.699823 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69c08543-24ca-4f08-8dcc-8dba103bf2ff req-1a21496e-3b84-4610-a6d2-a2e6ea38bef2 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:09.700499 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-69c08543-24ca-4f08-8dcc-8dba103bf2ff req-1a21496e-3b84-4610-a6d2-a2e6ea38bef2 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Synchronizing usage tracker for tenant:0f63ca6fed3e47a6a676979240aef5c0 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:12:09.846383 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-9e52c4f3-4cc9-4595-8332-066f7d0fbf50 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:09.847472 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-9e52c4f3-4cc9-4595-8332-066f7d0fbf50 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/ba8afff6-fc0d-46f5-b9b9-aa17904b3040 HTTP/1.1" status: 204  len: 168 time: 1.1048188
Jun 01 06:12:09.865497 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b31452-ab53-441c-a39e-51917485c258 req-a0d5a5b1-c60f-4358-b9f5-f10cb04c32b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:09.866936 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a8b31452-ab53-441c-a39e-51917485c258 req-a0d5a5b1-c60f-4358-b9f5-f10cb04c32b7 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 1098 time: 0.7794333
Jun 01 06:12:09.914177 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-f7d2ce3a-36bf-48cc-8228-8f1647180052 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:09.915739 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-f7d2ce3a-36bf-48cc-8228-8f1647180052 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=ac4006667c3442a3910d548e9e9d22c0&device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 1096 time: 0.1884139
Jun 01 06:12:09.940294 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ade666c6-da86-4184-b145-53070a765925 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:09.951539 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-69c08543-24ca-4f08-8dcc-8dba103bf2ff req-1a21496e-3b84-4610-a6d2-a2e6ea38bef2 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Unset dirty status for tenant:0f63ca6fed3e47a6a676979240aef5c0 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:12:09.952735 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-69c08543-24ca-4f08-8dcc-8dba103bf2ff req-1a21496e-3b84-4610-a6d2-a2e6ea38bef2 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 931 time: 0.9664550
Jun 01 06:12:09.978712 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ade666c6-da86-4184-b145-53070a765925 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:10.004564 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-4f85d918-780f-46cd-ba81-f3b4f6d4d2d2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Notify callbacks [] for port, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:10.008765 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-3c9c627f-a78b-4fe8-9043-584855ebe8a4 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=42597738-974b-4af6-a799-e37d02b057b9 HTTP/1.1" status: 200  len: 217 time: 0.0807743
Jun 01 06:12:10.086749 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-ceec5620-6de3-446a-8f37-1ced85426248 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:10.088247 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-ceec5620-6de3-446a-8f37-1ced85426248 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=3e980239-de35-45a0-8039-8395b5408617 HTTP/1.1" status: 200  len: 850 time: 0.0734684
Jun 01 06:12:10.108313 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-da274307-3a1d-4ac1-85c8-abc5ecf34364 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:10.203202 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-4f85d918-780f-46cd-ba81-f3b4f6d4d2d2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:10.216594 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52e9d8c5-b4de-491b-86b6-73178c6b306d req-a7a22257-824b-4436-b414-bbb4a8515beb tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:10.218676 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:10.223759 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-52e9d8c5-b4de-491b-86b6-73178c6b306d req-a7a22257-824b-4436-b414-bbb4a8515beb tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 945 time: 0.7982559
Jun 01 06:12:10.254928 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a8b31452-ab53-441c-a39e-51917485c258 req-fc80eef4-9880-470d-93b9-00b6421b5c5a service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3643897
Jun 01 06:12:10.296938 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-4f85d918-780f-46cd-ba81-f3b4f6d4d2d2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Network 6e45a0e5-f930-4b18-8f4f-1693815eb31a is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:12:10.300379 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-5183cb5e-e975-4291-8e4f-760538238af5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:10.302583 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-5183cb5e-e975-4291-8e4f-760538238af5 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=0890ab9c-2266-4ef4-af73-d3ff421b9bd7&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2051716
Jun 01 06:12:10.317008 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-4f85d918-780f-46cd-ba81-f3b4f6d4d2d2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:12:10.479170 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-4f85d918-780f-46cd-ba81-f3b4f6d4d2d2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Received port after_create {{(pid=92230) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:12:10.485522 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-4f85d918-780f-46cd-ba81-f3b4f6d4d2d2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:10.486150 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-4f85d918-780f-46cd-ba81-f3b4f6d4d2d2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for port, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:10.507563 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-c3a5d47e-7320-49ee-aa10-c4af6475cbcc service neutron] 10.222.0.48 "GET /v2.0/networks/0890ab9c-2266-4ef4-af73-d3ff421b9bd7?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1825848
Jun 01 06:12:10.521692 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 826848c6-a93a-4712-82dd-39e403bcb79e {{(pid=92229) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:12:10.532129 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:10.544489 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f85d918-780f-46cd-ba81-f3b4f6d4d2d2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Pushing event updated for resources: {'Port': ['ID=6596ca76-68f1-4ba1-ad74-a27f199ef442,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:10.555437 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-4f85d918-780f-46cd-ba81-f3b4f6d4d2d2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.337s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:10.563179 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Transition to ACTIVE for port object 826848c6-a93a-4712-82dd-39e403bcb79e will not be triggered until provisioned by entity L2. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:12:10.570726 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-ade666c6-da86-4184-b145-53070a765925 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=3dec26e8e0e34f818f4870fd41cfdfb7&name=default HTTP/1.1" status: 200  len: 2979 time: 1.9590852
Jun 01 06:12:10.580258 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 60230) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:10.581965 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ade666c6-da86-4184-b145-53070a765925 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5fd3c845-19c0-4828-b97b-e265d2c156f3,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:10.607328 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ade666c6-da86-4184-b145-53070a765925 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.499s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:10.610711 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-69c08543-24ca-4f08-8dcc-8dba103bf2ff req-61c4bf55-0867-4f2b-aca0-a498843cbc81 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.5442886
Jun 01 06:12:10.611368 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:10.628636 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-4f85d918-780f-46cd-ba81-f3b4f6d4d2d2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.7800741
Jun 01 06:12:10.648999 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Request body: {'port': {'device_id': '72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79388'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:12:10.674378 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-dda4501d-a333-462a-93c2-2256d43e1590 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:10.734954 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-92f09bd3-18f5-4db7-a03e-ed8a8c53f952 service neutron] 10.222.0.48 "GET /v2.0/networks/0890ab9c-2266-4ef4-af73-d3ff421b9bd7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2162764
Jun 01 06:12:10.758843 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Pushing event updated for resources: {'Port': ['ID=826848c6-a93a-4712-82dd-39e403bcb79e,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:10.839594 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-52e9d8c5-b4de-491b-86b6-73178c6b306d req-57658e6c-9c5a-419a-8639-48e47c5400cb tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.6148458
Jun 01 06:12:10.842279 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:10.853841 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:11.047358 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5f320f89-ada2-472d-b9ac-0676b4c4b578 {{(pid=92229) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:12:11.180016 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:11.212598 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:11.237428 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Attempting to bind port 826848c6-a93a-4712-82dd-39e403bcb79e on host hv-cinder-79388 for vnic_type normal with profile  {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:12:11.237753 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Attempting to bind port 826848c6-a93a-4712-82dd-39e403bcb79e by drivers openvswitch,hyperv on host hv-cinder-79388 at level 0 using segments [{'id': '79adeacf-7d8b-48ea-a63b-df4d7bfff135', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 245, 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2'}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:12:11.238073 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Attempting to bind port 826848c6-a93a-4712-82dd-39e403bcb79e on network 5f973ed4-521b-4b78-9a54-1336b1302fa2 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:12:11.247056 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Transition to ACTIVE for port object 5f320f89-ada2-472d-b9ac-0676b4c4b578 will not be triggered until provisioned by entity L2. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:12:11.268758 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:11.269458 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Port 826848c6-a93a-4712-82dd-39e403bcb79e on network 5f973ed4-521b-4b78-9a54-1336b1302fa2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79388 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 06:12:11.269775 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Attempting to bind port 826848c6-a93a-4712-82dd-39e403bcb79e on network 5f973ed4-521b-4b78-9a54-1336b1302fa2 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:12:11.275408 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-84cc4973-ff52-4e9a-b21c-cfc948849ac2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:11.286990 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:11.321853 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Checking agent: {'id': '56148394-2131-4d06-bcfa-c032301591b8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79388', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'started_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 11, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:12:11.322226 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Checking segment: {'id': '79adeacf-7d8b-48ea-a63b-df4d7bfff135', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 245, 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:12:11.322611 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Bound using segment: {'id': '79adeacf-7d8b-48ea-a63b-df4d7bfff135', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 245, 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2'} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:12:11.323053 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Bound port: 826848c6-a93a-4712-82dd-39e403bcb79e, host: hv-cinder-79388, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '79adeacf-7d8b-48ea-a63b-df4d7bfff135', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 245, 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2'}}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:12:11.323388 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:11.473432 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.notifiers.nova [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6596ca76-68f1-4ba1-ad74-a27f199ef442 {{(pid=92230) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:12:11.486379 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Notify callbacks [] for port, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:11.499022 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-84cc4973-ff52-4e9a-b21c-cfc948849ac2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:11.509308 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.provisioning_blocks [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Transition to ACTIVE for port object 6596ca76-68f1-4ba1-ad74-a27f199ef442 will not be triggered until provisioned by entity L2. {{(pid=92230) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:12:11.516296 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:11.517667 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77d9b6fa-0f13-45d4-b6e7-ff6bd73b745a req-d51f4906-7e40-4cb4-b78b-299f5f9a43b7 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:11.519224 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-77d9b6fa-0f13-45d4-b6e7-ff6bd73b745a req-d51f4906-7e40-4cb4-b78b-299f5f9a43b7 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 931 time: 0.6728315
Jun 01 06:12:11.534773 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:11.731137 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Pushing event updated for resources: {'Port': ['ID=6596ca76-68f1-4ba1-ad74-a27f199ef442,revision_number=2']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:11.736099 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:11.741507 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.managers [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Attempting to bind port 6596ca76-68f1-4ba1-ad74-a27f199ef442 on host hv-cinder-79388 for vnic_type normal with profile  {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:12:11.741821 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.managers [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Attempting to bind port 6596ca76-68f1-4ba1-ad74-a27f199ef442 by drivers openvswitch,hyperv on host hv-cinder-79388 at level 0 using segments [{'id': '1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 242, 'network_id': '6e45a0e5-f930-4b18-8f4f-1693815eb31a'}] {{(pid=92230) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:12:11.742341 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Attempting to bind port 6596ca76-68f1-4ba1-ad74-a27f199ef442 on network 6e45a0e5-f930-4b18-8f4f-1693815eb31a {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:12:11.761643 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Pushing event updated for resources: {'Port': ['ID=5f320f89-ada2-472d-b9ac-0676b4c4b578,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:11.766983 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Port 6596ca76-68f1-4ba1-ad74-a27f199ef442 on network 6e45a0e5-f930-4b18-8f4f-1693815eb31a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79388 {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 06:12:11.768207 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Attempting to bind port 6596ca76-68f1-4ba1-ad74-a27f199ef442 on network 6e45a0e5-f930-4b18-8f4f-1693815eb31a {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:12:11.780139 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Checking agent: {'id': '56148394-2131-4d06-bcfa-c032301591b8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79388', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'started_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 11, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:12:11.780674 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Checking segment: {'id': '1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 242, 'network_id': '6e45a0e5-f930-4b18-8f4f-1693815eb31a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92230) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:12:11.781347 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Bound using segment: {'id': '1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 242, 'network_id': '6e45a0e5-f930-4b18-8f4f-1693815eb31a'} {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:12:11.781931 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.managers [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Bound port: 6596ca76-68f1-4ba1-ad74-a27f199ef442, host: hv-cinder-79388, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 242, 'network_id': '6e45a0e5-f930-4b18-8f4f-1693815eb31a'}}] {{(pid=92230) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:12:11.784682 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.498s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:11.784834 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:11.785767 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-84cc4973-ff52-4e9a-b21c-cfc948849ac2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:11.804265 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] For port 826848c6-a93a-4712-82dd-39e403bcb79e, host hv-cinder-79388, cleared binding levels {{(pid=92229) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:12:11.818144 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:11.841366 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6540df17-f448-4d52-8547-249fa1221f81 req-22c137fd-f9f9-4def-b154-0d18b44597c4 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:11.842893 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6540df17-f448-4d52-8547-249fa1221f81 req-22c137fd-f9f9-4def-b154-0d18b44597c4 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 943 time: 0.7428210
Jun 01 06:12:11.846724 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84cc4973-ff52-4e9a-b21c-cfc948849ac2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5fd3c845-19c0-4828-b97b-e265d2c156f3,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:11.848669 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-84cc4973-ff52-4e9a-b21c-cfc948849ac2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:11.852726 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-84cc4973-ff52-4e9a-b21c-cfc948849ac2 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/5fd3c845-19c0-4828-b97b-e265d2c156f3 HTTP/1.1" status: 204  len: 168 time: 1.2601306
Jun 01 06:12:11.870342 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-84cc4973-ff52-4e9a-b21c-cfc948849ac2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:11.906238 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-77d9b6fa-0f13-45d4-b6e7-ff6bd73b745a req-17b88b3a-5603-478c-bf9f-da621a9a62e6 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Synchronizing usage tracker for tenant:8f1cf739e243401eb5da7ee705e856de on resource:security_group {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:12:11.916480 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] For port 826848c6-a93a-4712-82dd-39e403bcb79e, host hv-cinder-79388, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=826848c6-a93a-4712-82dd-39e403bcb79e,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92229) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:12:11.940523 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-77d9b6fa-0f13-45d4-b6e7-ff6bd73b745a req-17b88b3a-5603-478c-bf9f-da621a9a62e6 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Unset dirty status for tenant:8f1cf739e243401eb5da7ee705e856de on resource:security_group {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:12:11.941701 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-77d9b6fa-0f13-45d4-b6e7-ff6bd73b745a req-17b88b3a-5603-478c-bf9f-da621a9a62e6 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1869876
Jun 01 06:12:11.942828 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:11.945212 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Attempting to bind port 5f320f89-ada2-472d-b9ac-0676b4c4b578 on host hv-cinder-79388 for vnic_type normal with profile  {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:12:11.945872 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Attempting to bind port 5f320f89-ada2-472d-b9ac-0676b4c4b578 by drivers openvswitch,hyperv on host hv-cinder-79388 at level 0 using segments [{'id': '1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 242, 'network_id': '6e45a0e5-f930-4b18-8f4f-1693815eb31a'}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:12:11.945973 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Attempting to bind port 5f320f89-ada2-472d-b9ac-0676b4c4b578 on network 6e45a0e5-f930-4b18-8f4f-1693815eb31a {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:12:11.953968 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] For port 6596ca76-68f1-4ba1-ad74-a27f199ef442, host hv-cinder-79388, cleared binding levels {{(pid=92230) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:12:11.963558 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] For port 6596ca76-68f1-4ba1-ad74-a27f199ef442, host hv-cinder-79388, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=6596ca76-68f1-4ba1-ad74-a27f199ef442,segment=NetworkSegment(1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e),segment_id=1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e)] {{(pid=92230) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:12:11.971606 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:11.976837 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:11.977971 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-530737e2-3229-40df-9a38-493b6999d3ac service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:12.062440 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6540df17-f448-4d52-8547-249fa1221f81 req-5f80b4cf-0b8b-4900-a98f-bac91e987e07 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1770048
Jun 01 06:12:12.071207 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Port 5f320f89-ada2-472d-b9ac-0676b4c4b578 on network 6e45a0e5-f930-4b18-8f4f-1693815eb31a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79388 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 06:12:12.071547 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Attempting to bind port 5f320f89-ada2-472d-b9ac-0676b4c4b578 on network 6e45a0e5-f930-4b18-8f4f-1693815eb31a {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:12:12.090939 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Checking agent: {'id': '56148394-2131-4d06-bcfa-c032301591b8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79388', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'started_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 11, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:12:12.091292 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Checking segment: {'id': '1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 242, 'network_id': '6e45a0e5-f930-4b18-8f4f-1693815eb31a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:12:12.091688 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Bound using segment: {'id': '1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 242, 'network_id': '6e45a0e5-f930-4b18-8f4f-1693815eb31a'} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:12:12.092158 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Bound port: 5f320f89-ada2-472d-b9ac-0676b4c4b578, host: hv-cinder-79388, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 242, 'network_id': '6e45a0e5-f930-4b18-8f4f-1693815eb31a'}}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:12:12.092514 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:12.114171 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Pushing event updated for resources: {'Port': ['ID=826848c6-a93a-4712-82dd-39e403bcb79e,revision_number=3']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:12.140573 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:12.156891 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:12.157874 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for port, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:12.161658 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] 10.222.0.48 "PUT /v2.0/ports/6596ca76-68f1-4ba1-ad74-a27f199ef442 HTTP/1.1" status: 200  len: 1093 time: 1.5227664
Jun 01 06:12:12.163176 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a', 'tag': '6596ca76-68f1-4ba1-ad74-a27f199ef442'}] {{(pid=92230) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:12:12.171239 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a8971187fdc179bafebfda031591b22633150c3ea1d9449252a7819502f19756" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b9de689b-9095-4046-8511-724bf2c22e83" -d '{"events": [{"name": "network-changed", "server_uuid": "72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a", "tag": "6596ca76-68f1-4ba1-ad74-a27f199ef442"}]}' {{(pid=92230) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:12:12.209448 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Pushing event updated for resources: {'Port': ['ID=6596ca76-68f1-4ba1-ad74-a27f199ef442,revision_number=3']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:12.221267 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.243s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:12.320639 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:12.326174 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:12.338370 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] 10.222.0.48 "PUT /v2.0/ports/826848c6-a93a-4712-82dd-39e403bcb79e HTTP/1.1" status: 200  len: 1093 time: 3.4493847
Jun 01 06:12:12.342579 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1385f5c8-2a7a-45b1-a982-6f897700aa17', 'tag': '826848c6-a93a-4712-82dd-39e403bcb79e'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:12:12.346554 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-62ab531a-601c-4aa2-90dc-a7bf7e5a4cc2" -d '{"events": [{"name": "network-changed", "server_uuid": "1385f5c8-2a7a-45b1-a982-6f897700aa17", "tag": "826848c6-a93a-4712-82dd-39e403bcb79e"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:12:12.410154 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-4fa73fe3-8d4a-4cd3-bd3f-f56f61f33ac2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:12.422827 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-4fa73fe3-8d4a-4cd3-bd3f-f56f61f33ac2 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=8f1cf739e243401eb5da7ee705e856de&device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 1096 time: 0.2003179
Jun 01 06:12:12.436567 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-2eec848a-d1cf-4577-984e-4d37a748212d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:12.521075 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-7985170b-a0fb-45b2-81db-9227195a36d3 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=6596ca76-68f1-4ba1-ad74-a27f199ef442 HTTP/1.1" status: 200  len: 217 time: 0.0918648
Jun 01 06:12:12.637247 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-7544b388-24b7-4378-bb53-1f6ef8fa745a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:12.639411 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-7544b388-24b7-4378-bb53-1f6ef8fa745a service neutron] 10.222.0.48 "GET /v2.0/subnets?id=84c296fc-69c0-46e2-b1ed-e3edf435b759 HTTP/1.1" status: 200  len: 858 time: 0.1011832
Jun 01 06:12:12.702279 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 60288) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:12.705210 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-cf1d7c9e-b3f3-4655-87fa-e44579a1f27d service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=6e45a0e5-f930-4b18-8f4f-1693815eb31a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0564868
Jun 01 06:12:12.755538 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] For port 5f320f89-ada2-472d-b9ac-0676b4c4b578, host hv-cinder-79388, cleared binding levels {{(pid=92229) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:12:12.759082 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-a5ff1387-48fa-41a1-b619-fca54ab6824c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:12.795282 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] For port 5f320f89-ada2-472d-b9ac-0676b4c4b578, host hv-cinder-79388, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=5f320f89-ada2-472d-b9ac-0676b4c4b578,segment=NetworkSegment(1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e),segment_id=1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e)] {{(pid=92229) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:12:12.804929 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-a5ff1387-48fa-41a1-b619-fca54ab6824c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:12.814272 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:12.818379 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-a5ff1387-48fa-41a1-b619-fca54ab6824c admin admin] Usage tracker for resource:security_group_rule and tenant:8af5b6b161c548f9b76d3d4dbbbbc9f6 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:12.828312 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-a5ff1387-48fa-41a1-b619-fca54ab6824c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:12.834646 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:12.864376 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-d7a8645f-bc81-432d-a6f5-6b45a516ad74 service neutron] 10.222.0.48 "GET /v2.0/networks/6e45a0e5-f930-4b18-8f4f-1693815eb31a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1403127
Jun 01 06:12:12.881680 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-a5ff1387-48fa-41a1-b619-fca54ab6824c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:12.923152 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:12.924039 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:12.925457 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] 10.222.0.48 "PUT /v2.0/ports/5f320f89-ada2-472d-b9ac-0676b4c4b578 HTTP/1.1" status: 200  len: 1093 time: 4.0359385
Jun 01 06:12:12.947442 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3180b4b6-3f33-4f01-9232-1e907f664948 req-af050f85-28ad-4ce7-9a69-3e75e77086a7 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:12.947442 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3180b4b6-3f33-4f01-9232-1e907f664948 req-af050f85-28ad-4ce7-9a69-3e75e77086a7 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.6275351
Jun 01 06:12:12.957504 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e32cd281-1c12-4f63-84cb-624dd2914274 req-d2422e0d-3104-4b51-9c6e-72f1de60da55 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:12.959022 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e32cd281-1c12-4f63-84cb-624dd2914274 req-d2422e0d-3104-4b51-9c6e-72f1de60da55 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 945 time: 0.5023968
Jun 01 06:12:12.983684 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-bb61a969-0e7c-43cd-ad2d-0bea2c1f4aec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:12.985210 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-bb61a969-0e7c-43cd-ad2d-0bea2c1f4aec service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=0f63ca6fed3e47a6a676979240aef5c0&device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 1096 time: 0.5273576
Jun 01 06:12:13.001900 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 60298) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:13.032446 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Pushing event updated for resources: {'Port': ['ID=5f320f89-ada2-472d-b9ac-0676b4c4b578,revision_number=3']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:13.035907 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:13.079627 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3180b4b6-3f33-4f01-9232-1e907f664948 req-f7d2ed41-c18e-4b5d-8709-958d89104ccc tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1167641
Jun 01 06:12:13.094987 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e32cd281-1c12-4f63-84cb-624dd2914274 req-2466047b-61eb-4376-b317-7a08b6d5843c tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1291776
Jun 01 06:12:13.149114 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-cab96cb6-c8cf-46fb-a04e-ecb044dc0866 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:13.165889 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-a5ff1387-48fa-41a1-b619-fca54ab6824c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:13.166898 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-cab96cb6-c8cf-46fb-a04e-ecb044dc0866 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:13.173462 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:12:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-be5b5a27-cb89-4829-b84e-64ca084a2bba x-openstack-request-id: req-be5b5a27-cb89-4829-b84e-64ca084a2bba {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:12:13.173788 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1385f5c8-2a7a-45b1-a982-6f897700aa17", "tag": "826848c6-a93a-4712-82dd-39e403bcb79e", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:12:13.174204 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-be5b5a27-cb89-4829-b84e-64ca084a2bba {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:12:13.174685 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1385f5c8-2a7a-45b1-a982-6f897700aa17', 'tag': '826848c6-a93a-4712-82dd-39e403bcb79e', 'status': 'completed', 'code': 200}
Jun 01 06:12:13.175347 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-cab96cb6-c8cf-46fb-a04e-ecb044dc0866 admin admin] Usage tracker for resource:security_group_rule and tenant:9bba33a4c4f1401f89cdd5cc93bb09b2 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:13.175623 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-a5ff1387-48fa-41a1-b619-fca54ab6824c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:13.180389 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:12:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-037531c4-cd98-40b0-adee-a1caaa350818 x-openstack-request-id: req-037531c4-cd98-40b0-adee-a1caaa350818 {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:12:13.180868 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a", "tag": "6596ca76-68f1-4ba1-ad74-a27f199ef442", "status": "completed", "code": 200}]} {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:12:13.181282 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-037531c4-cd98-40b0-adee-a1caaa350818 {{(pid=92230) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:12:13.181831 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a', 'tag': '6596ca76-68f1-4ba1-ad74-a27f199ef442', 'status': 'completed', 'code': 200}
Jun 01 06:12:13.183267 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-cab96cb6-c8cf-46fb-a04e-ecb044dc0866 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:13.191329 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-cab96cb6-c8cf-46fb-a04e-ecb044dc0866 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:13.254397 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b356a992-140f-4da8-bcaf-8b1bb8000284 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:13.260632 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:13.297806 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-cab96cb6-c8cf-46fb-a04e-ecb044dc0866 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:13.302445 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-cab96cb6-c8cf-46fb-a04e-ecb044dc0866 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:13.319361 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-a5ff1387-48fa-41a1-b619-fca54ab6824c admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=8af5b6b161c548f9b76d3d4dbbbbc9f6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6070843
Jun 01 06:12:13.321081 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 60308) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:13.335195 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:13.345411 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-cab96cb6-c8cf-46fb-a04e-ecb044dc0866 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=9bba33a4c4f1401f89cdd5cc93bb09b2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3423598
Jun 01 06:12:13.348070 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 60312) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:13.398935 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cab96cb6-c8cf-46fb-a04e-ecb044dc0866 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7f97b625-673d-4227-ad7a-9bee64edb4c1,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:13.403721 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-cab96cb6-c8cf-46fb-a04e-ecb044dc0866 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:13.440238 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5ff1387-48fa-41a1-b619-fca54ab6824c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=969f2893-75c2-4a6c-820c-924bcb7df184,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:13.443707 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-cee4d9a0-b7a1-4f87-a574-316e7ab15ea4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:13.473359 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-cee4d9a0-b7a1-4f87-a574-316e7ab15ea4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:13.491184 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-a5ff1387-48fa-41a1-b619-fca54ab6824c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.237s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:13.541152 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-cee4d9a0-b7a1-4f87-a574-316e7ab15ea4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:13.549551 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:13.564384 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cee4d9a0-b7a1-4f87-a574-316e7ab15ea4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7f97b625-673d-4227-ad7a-9bee64edb4c1,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:13.566892 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-cee4d9a0-b7a1-4f87-a574-316e7ab15ea4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:13.580616 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-cee4d9a0-b7a1-4f87-a574-316e7ab15ea4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:13.581752 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-cee4d9a0-b7a1-4f87-a574-316e7ab15ea4 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/7f97b625-673d-4227-ad7a-9bee64edb4c1 HTTP/1.1" status: 204  len: 168 time: 0.2327828
Jun 01 06:12:13.630713 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-6287e5a7-7c55-4364-b845-dcff9f12c673 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:13.672080 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-6287e5a7-7c55-4364-b845-dcff9f12c673 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:13.693668 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d424a6a6-e2e5-4dab-ac86-06d5360a74dd req-ae4ad901-c64a-4ba1-b66c-73c20d2b0ddc tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:13.695223 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d424a6a6-e2e5-4dab-ac86-06d5360a74dd req-ae4ad901-c64a-4ba1-b66c-73c20d2b0ddc tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 943 time: 0.2764637
Jun 01 06:12:13.709075 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dce7a9d-13a7-4d80-a87f-65f740feca30 req-9d2a9868-4afc-4379-b8db-549db20cee38 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:13.712337 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8dce7a9d-13a7-4d80-a87f-65f740feca30 req-9d2a9868-4afc-4379-b8db-549db20cee38 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 943 time: 0.3818612
Jun 01 06:12:13.832182 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8dce7a9d-13a7-4d80-a87f-65f740feca30 req-493660e2-898a-43f0-bcb9-9c8560740dcc tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1013935
Jun 01 06:12:13.836687 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d424a6a6-e2e5-4dab-ac86-06d5360a74dd req-1d8fba36-0542-4644-8c5b-09ef9ea6e569 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1090953
Jun 01 06:12:13.865063 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-6287e5a7-7c55-4364-b845-dcff9f12c673 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:13.871574 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-a5ff1387-48fa-41a1-b619-fca54ab6824c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:13.888731 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6287e5a7-7c55-4364-b845-dcff9f12c673 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=969f2893-75c2-4a6c-820c-924bcb7df184,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:13.891687 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-6287e5a7-7c55-4364-b845-dcff9f12c673 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:13.893647 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-6287e5a7-7c55-4364-b845-dcff9f12c673 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:13.897314 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-6287e5a7-7c55-4364-b845-dcff9f12c673 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/969f2893-75c2-4a6c-820c-924bcb7df184 HTTP/1.1" status: 204  len: 168 time: 0.5598648
Jun 01 06:12:13.969281 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 60330) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:13.995160 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-39390b8b-857f-40a1-b112-95d1f076fad0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:14.011284 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-39390b8b-857f-40a1-b112-95d1f076fad0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:14.016037 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-39390b8b-857f-40a1-b112-95d1f076fad0 admin admin] Usage tracker for resource:security_group_rule and tenant:7748c40368d746df834af6ee18910e64 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:14.019082 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-39390b8b-857f-40a1-b112-95d1f076fad0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:14.025421 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-39390b8b-857f-40a1-b112-95d1f076fad0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:14.131394 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-39390b8b-857f-40a1-b112-95d1f076fad0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:14.137519 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-39390b8b-857f-40a1-b112-95d1f076fad0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:14.146877 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-fbb7642f-091b-4c16-9611-78be61f7d0df admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:14.180586 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39390b8b-857f-40a1-b112-95d1f076fad0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=827a827f-da58-4d30-915e-981d38166615,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:14.196287 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-39390b8b-857f-40a1-b112-95d1f076fad0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:14.207356 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-39390b8b-857f-40a1-b112-95d1f076fad0 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=7748c40368d746df834af6ee18910e64&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2369695
Jun 01 06:12:14.210021 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 60340) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:14.278826 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-6398b1f8-11f6-4647-96a1-7aebafb78dc8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:14.306067 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f210fbd4-5f2d-4fbe-aeeb-37052964c78f req-0ba86a72-394a-41a0-8e56-9af559f614c1 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:14.307659 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f210fbd4-5f2d-4fbe-aeeb-37052964c78f req-0ba86a72-394a-41a0-8e56-9af559f614c1 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.0936496
Jun 01 06:12:14.311069 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-6398b1f8-11f6-4647-96a1-7aebafb78dc8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:14.365913 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f210fbd4-5f2d-4fbe-aeeb-37052964c78f req-f7afd822-e3af-463c-9e49-c11e81f4711a tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0505667
Jun 01 06:12:14.378333 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-6398b1f8-11f6-4647-96a1-7aebafb78dc8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:14.383368 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-dac4da19-4f28-4d74-966f-4d5228dfec9e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:14.398149 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6398b1f8-11f6-4647-96a1-7aebafb78dc8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=827a827f-da58-4d30-915e-981d38166615,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:14.402434 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-6398b1f8-11f6-4647-96a1-7aebafb78dc8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:14.407499 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-6398b1f8-11f6-4647-96a1-7aebafb78dc8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:14.408975 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-6398b1f8-11f6-4647-96a1-7aebafb78dc8 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/827a827f-da58-4d30-915e-981d38166615 HTTP/1.1" status: 204  len: 168 time: 0.1980374
Jun 01 06:12:14.786873 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 42597738-974b-4af6-a799-e37d02b057b9 details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:12:14.959576 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 42597738-974b-4af6-a799-e37d02b057b9, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=42597738-974b-4af6-a799-e37d02b057b9,segment=NetworkSegment(5dda6d07-db2a-40a3-815e-42df1528c630),segment_id=5dda6d07-db2a-40a3-815e-42df1528c630)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:12:14.977459 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': '42597738-974b-4af6-a799-e37d02b057b9', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'port_id': '42597738-974b-4af6-a799-e37d02b057b9', 'mac_address': 'fa:16:3e:11:73:ec', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 224, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3e980239-de35-45a0-8039-8395b5408617', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:12:15.064146 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:15.087682 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 42597738-974b-4af6-a799-e37d02b057b9 {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:12:15.112368 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 42597738-974b-4af6-a799-e37d02b057b9, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=42597738-974b-4af6-a799-e37d02b057b9,segment=NetworkSegment(5dda6d07-db2a-40a3-815e-42df1528c630),segment_id=5dda6d07-db2a-40a3-815e-42df1528c630)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:12:15.117818 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:15.120300 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:15.178168 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dc8bf0a9-503e-487c-975a-ec720e525cf1', 'tag': '5f320f89-ada2-472d-b9ac-0676b4c4b578'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:12:15.181248 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3c0ae48c-248a-4936-a86d-6e4736e799fb" -d '{"events": [{"name": "network-changed", "server_uuid": "dc8bf0a9-503e-487c-975a-ec720e525cf1", "tag": "5f320f89-ada2-472d-b9ac-0676b4c4b578"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:12:15.232475 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dc9a04e-bbd9-4a09-a447-62ec3938d65e req-f70c97b9-8295-4e99-86de-e46915f4a53d tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:15.234255 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8dc9a04e-bbd9-4a09-a447-62ec3938d65e req-f70c97b9-8295-4e99-86de-e46915f4a53d tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 944 time: 0.1554022
Jun 01 06:12:15.248041 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba6663bb-460d-4a8d-bb39-34b667c93f43 req-4c5c2896-8c12-40e9-927c-69d2112882ba tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:15.249948 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ba6663bb-460d-4a8d-bb39-34b667c93f43 req-4c5c2896-8c12-40e9-927c-69d2112882ba tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 943 time: 0.2112613
Jun 01 06:12:15.275943 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=42597738-974b-4af6-a799-e37d02b057b9,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:15.288336 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:15.330285 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ba6663bb-460d-4a8d-bb39-34b667c93f43 req-f8ad01e3-213f-473f-b793-1b569565b9ec tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0599902
Jun 01 06:12:15.338921 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8dc9a04e-bbd9-4a09-a447-62ec3938d65e req-2eeedf74-bbe2-48a2-8d03-09b40811994c tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0871146
Jun 01 06:12:15.343187 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:15.396242 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:12:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9a726418-0c46-4412-9d8e-646f4a48c8db x-openstack-request-id: req-9a726418-0c46-4412-9d8e-646f4a48c8db {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:12:15.396242 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dc8bf0a9-503e-487c-975a-ec720e525cf1", "tag": "5f320f89-ada2-472d-b9ac-0676b4c4b578", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:12:15.396242 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-9a726418-0c46-4412-9d8e-646f4a48c8db {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:12:15.396242 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dc8bf0a9-503e-487c-975a-ec720e525cf1', 'tag': '5f320f89-ada2-472d-b9ac-0676b4c4b578', 'status': 'completed', 'code': 200}
Jun 01 06:12:15.579200 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ebd499b-e370-4f4c-ae01-2492dfa8061e req-6c2a6d86-e2cc-4515-bba0-ac07b49f6ff1 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:15.580845 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7ebd499b-e370-4f4c-ae01-2492dfa8061e req-6c2a6d86-e2cc-4515-bba0-ac07b49f6ff1 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.0975585
Jun 01 06:12:15.652311 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7ebd499b-e370-4f4c-ae01-2492dfa8061e req-9f83610b-6b5c-4780-9a29-2b69a318f3ec tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0639095
Jun 01 06:12:15.956182 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:16.065946 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-3e1aaf32-59c4-433a-8f53-53ff1326157d service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=826848c6-a93a-4712-82dd-39e403bcb79e HTTP/1.1" status: 200  len: 217 time: 0.1432312
Jun 01 06:12:16.169628 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-96a49bfc-ed7a-44ba-ba0e-387b8be281f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:16.171102 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-96a49bfc-ed7a-44ba-ba0e-387b8be281f8 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=6137ee10-ce13-45c9-8edb-31811502bfd7 HTTP/1.1" status: 200  len: 855 time: 0.0925403
Jun 01 06:12:16.181017 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-09aced06-b4ef-4223-b1df-7b1eaad6d1a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:16.182583 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-09aced06-b4ef-4223-b1df-7b1eaad6d1a8 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=8f1cf739e243401eb5da7ee705e856de&device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 1096 time: 0.1762087
Jun 01 06:12:16.202450 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-3e08c06a-4551-4ea4-994f-4877132b6143 req-b2fc481e-66ba-4b33-9200-a101c6386ed6 service neutron] 10.222.0.48 "GET /v2.0/networks/6e45a0e5-f930-4b18-8f4f-1693815eb31a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2997339
Jun 01 06:12:16.278154 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['42597738-974b-4af6-a799-e37d02b057b9'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:12:16.302627 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-d61fb8f4-30c6-4f79-8b9a-f3c572a954a7 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5f320f89-ada2-472d-b9ac-0676b4c4b578 HTTP/1.1" status: 200  len: 217 time: 0.0819600
Jun 01 06:12:16.387597 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-9c11d110-0b86-4c74-a932-9e1b359873f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:16.389981 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-9c11d110-0b86-4c74-a932-9e1b359873f8 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=84c296fc-69c0-46e2-b1ed-e3edf435b759 HTTP/1.1" status: 200  len: 858 time: 0.0773780
Jun 01 06:12:16.397388 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-86b6bdf4-2ef7-463d-8df8-8b1819676b33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:16.399074 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-86b6bdf4-2ef7-463d-8df8-8b1819676b33 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=5f973ed4-521b-4b78-9a54-1336b1302fa2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2138798
Jun 01 06:12:16.649909 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-215552ad-867f-4255-ab00-352be6d53774 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=6e45a0e5-f930-4b18-8f4f-1693815eb31a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.2496758
Jun 01 06:12:16.770272 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9de689b-9095-4046-8511-724bf2c22e83 req-0d306814-d623-4c1e-be66-46fc7a92493a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:16.774427 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-b9de689b-9095-4046-8511-724bf2c22e83 req-0d306814-d623-4c1e-be66-46fc7a92493a service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=8f1cf739e243401eb5da7ee705e856de&device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 1096 time: 0.4989173
Jun 01 06:12:16.963260 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9de689b-9095-4046-8511-724bf2c22e83 req-b8ea7643-9e06-40dd-8962-16d39f17e9db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:16.964802 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-b9de689b-9095-4046-8511-724bf2c22e83 req-b8ea7643-9e06-40dd-8962-16d39f17e9db service neutron] 10.222.0.48 "GET /v2.0/networks?id=6e45a0e5-f930-4b18-8f4f-1693815eb31a HTTP/1.1" status: 200  len: 919 time: 0.1837456
Jun 01 06:12:17.067109 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-b9de689b-9095-4046-8511-724bf2c22e83 req-99c97950-c7de-42de-a491-326eb985a0e1 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=6596ca76-68f1-4ba1-ad74-a27f199ef442 HTTP/1.1" status: 200  len: 217 time: 0.0898321
Jun 01 06:12:17.110485 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-7d8294bd-d02e-4a9c-9496-71ad989d9e79 service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.6515830
Jun 01 06:12:17.191572 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9de689b-9095-4046-8511-724bf2c22e83 req-e7a6de3e-696f-4496-b804-0854591d31c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:17.193252 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-b9de689b-9095-4046-8511-724bf2c22e83 req-e7a6de3e-696f-4496-b804-0854591d31c4 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=84c296fc-69c0-46e2-b1ed-e3edf435b759 HTTP/1.1" status: 200  len: 858 time: 0.1165528
Jun 01 06:12:17.289011 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-47ad35f3-c342-4139-9098-59ea187dc668 service neutron] 10.222.0.48 "GET /v2.0/networks/6e45a0e5-f930-4b18-8f4f-1693815eb31a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4376471
Jun 01 06:12:17.300086 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-b9de689b-9095-4046-8511-724bf2c22e83 req-ab97e6bc-be82-406f-a0a3-61ab030a021e service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=6e45a0e5-f930-4b18-8f4f-1693815eb31a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0988569
Jun 01 06:12:17.347725 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e89b2c2b-c13b-486f-b51d-39d643d932eb req-76671ff3-e9d6-48dc-b7f9-0bdb152d4478 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:17.356930 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e89b2c2b-c13b-486f-b51d-39d643d932eb req-76671ff3-e9d6-48dc-b7f9-0bdb152d4478 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 943 time: 0.7133169
Jun 01 06:12:17.379381 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02916430-f8ad-4f50-b5ca-b3110b6f5680 req-10fe9260-505c-4dd7-b566-5b00f51e48ba tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:17.380889 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-02916430-f8ad-4f50-b5ca-b3110b6f5680 req-10fe9260-505c-4dd7-b566-5b00f51e48ba tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 944 time: 0.5242393
Jun 01 06:12:17.498205 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-b9de689b-9095-4046-8511-724bf2c22e83 req-94a1082c-62cc-479e-a269-ee76cb317c7e service neutron] 10.222.0.48 "GET /v2.0/networks/6e45a0e5-f930-4b18-8f4f-1693815eb31a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1837406
Jun 01 06:12:17.581907 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e89b2c2b-c13b-486f-b51d-39d643d932eb req-43387ab0-78ec-4604-9e50-92fb57f35c4a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2231896
Jun 01 06:12:17.584136 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a86d73e2-bd0b-440c-a08f-4e17f57eb7b7 req-45fabb90-94c2-4f9b-9719-3292a734e237 service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4644372
Jun 01 06:12:17.642958 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-02916430-f8ad-4f50-b5ca-b3110b6f5680 req-c0869cc8-1b56-4271-9f75-fa4d9b79cf4a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1852384
Jun 01 06:12:17.727622 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-b9de689b-9095-4046-8511-724bf2c22e83 req-202134b4-d094-49ad-b1ee-fd893681fa5d service neutron] 10.222.0.48 "GET /v2.0/networks/6e45a0e5-f930-4b18-8f4f-1693815eb31a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2222834
Jun 01 06:12:17.756768 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-13e2451d-0f04-4227-8eda-85d3a82e60ff req-eb623a4e-6df8-43c6-a0c3-ee9c6846b495 service neutron] 10.222.0.48 "GET /v2.0/networks/6e45a0e5-f930-4b18-8f4f-1693815eb31a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4544115
Jun 01 06:12:17.818294 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62ab531a-601c-4aa2-90dc-a7bf7e5a4cc2 req-94357657-b4e9-4343-98e3-cc9d6825e744 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:17.821605 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-62ab531a-601c-4aa2-90dc-a7bf7e5a4cc2 req-94357657-b4e9-4343-98e3-cc9d6825e744 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=0f63ca6fed3e47a6a676979240aef5c0&device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 1096 time: 0.1162658
Jun 01 06:12:17.921699 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 42597738-974b-4af6-a799-e37d02b057b9 up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:12:18.037806 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning for port 42597738-974b-4af6-a799-e37d02b057b9 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:12:18.045022 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port 42597738-974b-4af6-a799-e37d02b057b9 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:12:18.045658 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:18.124272 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62ab531a-601c-4aa2-90dc-a7bf7e5a4cc2 req-252eb86e-d0a3-41ac-9cfc-dab9135c5573 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:18.126529 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-62ab531a-601c-4aa2-90dc-a7bf7e5a4cc2 req-252eb86e-d0a3-41ac-9cfc-dab9135c5573 service neutron] 10.222.0.48 "GET /v2.0/networks?id=5f973ed4-521b-4b78-9a54-1336b1302fa2 HTTP/1.1" status: 200  len: 917 time: 0.2624264
Jun 01 06:12:18.139136 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c0ae48c-248a-4936-a86d-6e4736e799fb req-571c5fe1-581c-4698-8574-1a791fda7fda service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:18.141081 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3c0ae48c-248a-4936-a86d-6e4736e799fb req-571c5fe1-581c-4698-8574-1a791fda7fda service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=8f1cf739e243401eb5da7ee705e856de&device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 1096 time: 0.3183179
Jun 01 06:12:18.197415 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:18.229247 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'eb18f959-9e44-4148-a4fe-8f878905f76b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '42597738-974b-4af6-a799-e37d02b057b9'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:12:18.232123 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7b89d517-f598-4f7b-94c5-8ced931bd08e" -d '{"events": [{"server_uuid": "eb18f959-9e44-4148-a4fe-8f878905f76b", "name": "network-vif-plugged", "status": "completed", "tag": "42597738-974b-4af6-a799-e37d02b057b9"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:12:18.243240 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 42597738-974b-4af6-a799-e37d02b057b9, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=42597738-974b-4af6-a799-e37d02b057b9,segment=NetworkSegment(5dda6d07-db2a-40a3-815e-42df1528c630),segment_id=5dda6d07-db2a-40a3-815e-42df1528c630)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:12:18.246011 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc42fcb8-a956-47f0-b101-158c49000425 req-97ae7e4b-4524-4457-b146-12bf4bf6d18f tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:18.248739 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:18.252858 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:18.254095 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fc42fcb8-a956-47f0-b101-158c49000425 req-97ae7e4b-4524-4457-b146-12bf4bf6d18f tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.3882804
Jun 01 06:12:18.281995 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-62ab531a-601c-4aa2-90dc-a7bf7e5a4cc2 req-6a444c4e-6672-4a8a-bd9d-dba16a3aa3d3 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=826848c6-a93a-4712-82dd-39e403bcb79e HTTP/1.1" status: 200  len: 217 time: 0.1386793
Jun 01 06:12:18.342780 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=42597738-974b-4af6-a799-e37d02b057b9,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:18.346620 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:18.436875 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fc42fcb8-a956-47f0-b101-158c49000425 req-011a3927-cd65-4bd5-b92e-31f88d0c09e0 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1818261
Jun 01 06:12:18.462929 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:12:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3a90cb5d-6d0b-4b8d-94ab-594245f5dbac x-openstack-request-id: req-3a90cb5d-6d0b-4b8d-94ab-594245f5dbac {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:12:18.463223 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "eb18f959-9e44-4148-a4fe-8f878905f76b", "name": "network-vif-plugged", "status": "completed", "tag": "42597738-974b-4af6-a799-e37d02b057b9", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:12:18.463479 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-3a90cb5d-6d0b-4b8d-94ab-594245f5dbac {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:12:18.463902 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'eb18f959-9e44-4148-a4fe-8f878905f76b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '42597738-974b-4af6-a799-e37d02b057b9', 'code': 200}
Jun 01 06:12:18.482054 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62ab531a-601c-4aa2-90dc-a7bf7e5a4cc2 req-8f7b3140-51d6-4bfc-8dd5-ba082b357b76 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:18.482054 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-62ab531a-601c-4aa2-90dc-a7bf7e5a4cc2 req-8f7b3140-51d6-4bfc-8dd5-ba082b357b76 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=6137ee10-ce13-45c9-8edb-31811502bfd7 HTTP/1.1" status: 200  len: 855 time: 0.1483033
Jun 01 06:12:18.564692 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c0ae48c-248a-4936-a86d-6e4736e799fb req-8a82a7ca-7101-4caf-8898-64824f3aae5d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:18.566587 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3c0ae48c-248a-4936-a86d-6e4736e799fb req-8a82a7ca-7101-4caf-8898-64824f3aae5d service neutron] 10.222.0.48 "GET /v2.0/networks?id=6e45a0e5-f930-4b18-8f4f-1693815eb31a HTTP/1.1" status: 200  len: 919 time: 0.3628125
Jun 01 06:12:18.797069 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3c0ae48c-248a-4936-a86d-6e4736e799fb req-6e2029f0-7988-4c22-9efd-68f5e562e444 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5f320f89-ada2-472d-b9ac-0676b4c4b578 HTTP/1.1" status: 200  len: 217 time: 0.2155390
Jun 01 06:12:18.801509 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62ab531a-601c-4aa2-90dc-a7bf7e5a4cc2 req-97c4f21e-9045-480e-8a3f-d581238f9776 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:18.802894 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-62ab531a-601c-4aa2-90dc-a7bf7e5a4cc2 req-97c4f21e-9045-480e-8a3f-d581238f9776 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=5f973ed4-521b-4b78-9a54-1336b1302fa2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3093314
Jun 01 06:12:18.875763 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd593745-6bd8-4959-83c9-835851b6ad70 req-5facceff-5f9d-495c-a432-9f3cafdac517 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:18.877729 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-dd593745-6bd8-4959-83c9-835851b6ad70 req-5facceff-5f9d-495c-a432-9f3cafdac517 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 1098 time: 0.1524491
Jun 01 06:12:18.925258 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-dd593745-6bd8-4959-83c9-835851b6ad70 req-f56ce78a-aa9c-4c3d-9dbf-37db71afa726 service neutron] Synchronizing usage tracker for tenant:425177935298408eb3cf0461e02cb813 on resource:security_group {{(pid=92230) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:12:18.945535 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-dd593745-6bd8-4959-83c9-835851b6ad70 req-f56ce78a-aa9c-4c3d-9dbf-37db71afa726 service neutron] Unset dirty status for tenant:425177935298408eb3cf0461e02cb813 on resource:security_group {{(pid=92230) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:12:18.946671 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-dd593745-6bd8-4959-83c9-835851b6ad70 req-f56ce78a-aa9c-4c3d-9dbf-37db71afa726 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0597186
Jun 01 06:12:19.058798 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c0ae48c-248a-4936-a86d-6e4736e799fb req-4efc34a4-27d6-47df-a4af-d185c472c2db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:19.060974 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3c0ae48c-248a-4936-a86d-6e4736e799fb req-4efc34a4-27d6-47df-a4af-d185c472c2db service neutron] 10.222.0.48 "GET /v2.0/subnets?id=84c296fc-69c0-46e2-b1ed-e3edf435b759 HTTP/1.1" status: 200  len: 858 time: 0.2258813
Jun 01 06:12:19.140823 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3c0ae48c-248a-4936-a86d-6e4736e799fb req-89540f91-b8cb-48ff-90a3-892819998ce5 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=6e45a0e5-f930-4b18-8f4f-1693815eb31a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0695307
Jun 01 06:12:19.208213 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13916430-afc8-46a4-9c5d-1c99422eb7c6 req-4b74356b-abae-4580-8c36-e65492942afc tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:19.209662 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-13916430-afc8-46a4-9c5d-1c99422eb7c6 req-4b74356b-abae-4580-8c36-e65492942afc tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 943 time: 0.4111166
Jun 01 06:12:19.259985 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-62ab531a-601c-4aa2-90dc-a7bf7e5a4cc2 req-6a2050c9-0887-4ed3-8e00-22568c9d9084 service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4186862
Jun 01 06:12:19.318832 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec0dee2d-ac98-4cd2-979d-32d6e26ff340 req-7d9679fe-8a80-4194-8df9-8c52e09b61eb tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:19.320328 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ec0dee2d-ac98-4cd2-979d-32d6e26ff340 req-7d9679fe-8a80-4194-8df9-8c52e09b61eb tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.4174209
Jun 01 06:12:19.481841 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-13916430-afc8-46a4-9c5d-1c99422eb7c6 req-70037af0-97b5-4bc4-8ab8-385253eebe92 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2044384
Jun 01 06:12:19.514377 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ec0dee2d-ac98-4cd2-979d-32d6e26ff340 req-8937563a-0482-4c59-8f9c-f9984fbe1fe7 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1782992
Jun 01 06:12:19.521221 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3c0ae48c-248a-4936-a86d-6e4736e799fb req-c393625e-8376-4430-925b-5dbeccb8abd3 service neutron] 10.222.0.48 "GET /v2.0/networks/6e45a0e5-f930-4b18-8f4f-1693815eb31a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3666949
Jun 01 06:12:19.581188 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-62ab531a-601c-4aa2-90dc-a7bf7e5a4cc2 req-85d679cd-1406-43db-81bb-7a35b2c5bf63 service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3069384
Jun 01 06:12:19.798770 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0107f12-feb7-43b2-ac30-05b1578eb648 req-50706c24-822d-40dd-b500-ed21bd97b7e0 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:19.800746 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b0107f12-feb7-43b2-ac30-05b1578eb648 req-50706c24-822d-40dd-b500-ed21bd97b7e0 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.1145144
Jun 01 06:12:19.859197 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b0107f12-feb7-43b2-ac30-05b1578eb648 req-9553c84a-795e-4868-83c7-e6a11a75791f tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0498734
Jun 01 06:12:20.000005 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe265553-01f6-4384-85fd-d70e6ea9cb88 req-7b2a4c54-b0d2-4264-9a28-d026e2de6206 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:20.001492 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fe265553-01f6-4384-85fd-d70e6ea9cb88 req-7b2a4c54-b0d2-4264-9a28-d026e2de6206 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/ports?device_id=b662816d-f3d5-434d-b2c3-eb501ac85556 HTTP/1.1" status: 200  len: 946 time: 0.0856068
Jun 01 06:12:20.046202 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fe265553-01f6-4384-85fd-d70e6ea9cb88 req-8b2cf08d-910d-43a3-bbd0-2aea19c07dae tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/security-groups?id=322d6e24-5243-409c-8b80-acbe06176a3c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0389163
Jun 01 06:12:20.546585 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 5f320f89-ada2-472d-b9ac-0676b4c4b578 details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:12:20.686043 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 5f320f89-ada2-472d-b9ac-0676b4c4b578, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=5f320f89-ada2-472d-b9ac-0676b4c4b578,segment=NetworkSegment(1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e),segment_id=1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:12:20.700268 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': '5f320f89-ada2-472d-b9ac-0676b4c4b578', 'network_id': '6e45a0e5-f930-4b18-8f4f-1693815eb31a', 'port_id': '5f320f89-ada2-472d-b9ac-0676b4c4b578', 'mac_address': 'fa:16:3e:3a:a7:61', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 242, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '84c296fc-69c0-46e2-b1ed-e3edf435b759', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:12:20.731012 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-277660e7-9995-4ea9-a6d0-4edf4441ade0 req-33d90932-70c7-4fad-9f9b-47313c467bef tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:20.732510 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-277660e7-9995-4ea9-a6d0-4edf4441ade0 req-33d90932-70c7-4fad-9f9b-47313c467bef tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 943 time: 0.1436503
Jun 01 06:12:20.765487 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:20.769652 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d22c8446-1b16-486b-8b25-d8221f9e94d5 req-fffdaac2-138c-4729-9fdf-ea764312682b tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:20.777260 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d22c8446-1b16-486b-8b25-d8221f9e94d5 req-fffdaac2-138c-4729-9fdf-ea764312682b tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.1297886
Jun 01 06:12:20.813269 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5f320f89-ada2-472d-b9ac-0676b4c4b578 {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:12:20.833088 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 5f320f89-ada2-472d-b9ac-0676b4c4b578, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=5f320f89-ada2-472d-b9ac-0676b4c4b578,segment=NetworkSegment(1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e),segment_id=1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:12:20.840341 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:20.841490 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 826848c6-a93a-4712-82dd-39e403bcb79e details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:12:20.846269 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:20.847822 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d22c8446-1b16-486b-8b25-d8221f9e94d5 req-0895bf7c-d089-4e81-b91d-1eeebdad8a31 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0694835
Jun 01 06:12:20.853020 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-277660e7-9995-4ea9-a6d0-4edf4441ade0 req-800ce36f-7c8d-4751-9a33-c1ec3c40d054 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1138737
Jun 01 06:12:20.989376 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=5f320f89-ada2-472d-b9ac-0676b4c4b578,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:20.993858 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:21.047682 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 826848c6-a93a-4712-82dd-39e403bcb79e, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=826848c6-a93a-4712-82dd-39e403bcb79e,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:12:21.055104 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e01df2d3-2afa-4fb4-821c-46ee6c6c79c1 req-b5ff5e93-63a0-46c1-b56c-0957c04d2659 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:21.056590 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e01df2d3-2afa-4fb4-821c-46ee6c6c79c1 req-b5ff5e93-63a0-46c1-b56c-0957c04d2659 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.0820665
Jun 01 06:12:21.062279 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': '826848c6-a93a-4712-82dd-39e403bcb79e', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'port_id': '826848c6-a93a-4712-82dd-39e403bcb79e', 'mac_address': 'fa:16:3e:c4:14:7a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 245, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:12:21.105164 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e01df2d3-2afa-4fb4-821c-46ee6c6c79c1 req-f1fba004-ab14-44b7-8f71-3155697b0c2b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0416291
Jun 01 06:12:21.132832 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:21.150809 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 826848c6-a93a-4712-82dd-39e403bcb79e {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:12:21.166343 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 826848c6-a93a-4712-82dd-39e403bcb79e, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=826848c6-a93a-4712-82dd-39e403bcb79e,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:12:21.170448 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:21.171152 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 6596ca76-68f1-4ba1-ad74-a27f199ef442 details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:12:21.173160 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:21.243971 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41a1ffd0-1948-421e-ba55-6f1b849b8875 req-a4f4eac3-3297-4796-af07-b2aa16a18ad0 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:21.247606 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-41a1ffd0-1948-421e-ba55-6f1b849b8875 req-a4f4eac3-3297-4796-af07-b2aa16a18ad0 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/ports?device_id=b662816d-f3d5-434d-b2c3-eb501ac85556 HTTP/1.1" status: 200  len: 946 time: 0.0931072
Jun 01 06:12:21.255110 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 6596ca76-68f1-4ba1-ad74-a27f199ef442, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=6596ca76-68f1-4ba1-ad74-a27f199ef442,segment=NetworkSegment(1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e),segment_id=1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:12:21.263314 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=826848c6-a93a-4712-82dd-39e403bcb79e,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:21.268965 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:21.273323 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': '6596ca76-68f1-4ba1-ad74-a27f199ef442', 'network_id': '6e45a0e5-f930-4b18-8f4f-1693815eb31a', 'port_id': '6596ca76-68f1-4ba1-ad74-a27f199ef442', 'mac_address': 'fa:16:3e:00:7e:b9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 242, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '84c296fc-69c0-46e2-b1ed-e3edf435b759', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:12:21.296192 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-41a1ffd0-1948-421e-ba55-6f1b849b8875 req-386ddb59-4d7f-4743-95cf-57f41c4a5e2f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/security-groups?id=322d6e24-5243-409c-8b80-acbe06176a3c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0436316
Jun 01 06:12:21.334877 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:21.352996 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6596ca76-68f1-4ba1-ad74-a27f199ef442 {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:12:21.368005 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 6596ca76-68f1-4ba1-ad74-a27f199ef442, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=6596ca76-68f1-4ba1-ad74-a27f199ef442,segment=NetworkSegment(1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e),segment_id=1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:12:21.371919 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:21.373751 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:21.438670 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=6596ca76-68f1-4ba1-ad74-a27f199ef442,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:21.441569 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:21.587261 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3c0ae48c-248a-4936-a86d-6e4736e799fb req-3fc617b9-a861-44de-8183-79a5a7d2b63a service neutron] 10.222.0.48 "GET /v2.0/networks/6e45a0e5-f930-4b18-8f4f-1693815eb31a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1408043
Jun 01 06:12:22.164121 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af291504-fa2b-4330-a7ba-8e45747aed95 req-95690fd8-4577-4975-905b-89738901f91b tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:22.165476 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-af291504-fa2b-4330-a7ba-8e45747aed95 req-95690fd8-4577-4975-905b-89738901f91b tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.2080569
Jun 01 06:12:22.173959 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7f35fba-bea9-4b70-b7f4-ddccedf59ada req-698336fe-58cb-487c-8e58-a5e0bf650f60 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:22.175290 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e7f35fba-bea9-4b70-b7f4-ddccedf59ada req-698336fe-58cb-487c-8e58-a5e0bf650f60 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 944 time: 0.1857841
Jun 01 06:12:22.242625 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-af291504-fa2b-4330-a7ba-8e45747aed95 req-d45e11fc-39ea-4bf2-9320-e71c9da4859a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0663741
Jun 01 06:12:22.247448 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e7f35fba-bea9-4b70-b7f4-ddccedf59ada req-bdd6a85d-226c-4086-a0d9-c53fd271a09e tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0584650
Jun 01 06:12:22.427382 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-762fa0d2-3302-4ba8-86a0-b9043a8d876d req-42b46c2d-716e-40fa-9ff7-02af148da2a0 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:22.428807 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-762fa0d2-3302-4ba8-86a0-b9043a8d876d req-42b46c2d-716e-40fa-9ff7-02af148da2a0 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 944 time: 0.0882940
Jun 01 06:12:22.524894 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-762fa0d2-3302-4ba8-86a0-b9043a8d876d req-6692781e-a478-4ba3-9b22-eb1ec7329c7e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0597198
Jun 01 06:12:22.548359 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35c4d7c7-773d-4afa-b59f-414cc17503f0 req-ccb641da-a7d1-40bd-b4a8-b4694c6a2ae5 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:22.549891 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-35c4d7c7-773d-4afa-b59f-414cc17503f0 req-ccb641da-a7d1-40bd-b4a8-b4694c6a2ae5 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/ports?device_id=b662816d-f3d5-434d-b2c3-eb501ac85556 HTTP/1.1" status: 200  len: 946 time: 0.1202571
Jun 01 06:12:22.608906 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-35c4d7c7-773d-4afa-b59f-414cc17503f0 req-36a76a89-00f8-44d1-a549-2087728c289c tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/security-groups?id=322d6e24-5243-409c-8b80-acbe06176a3c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0487437
Jun 01 06:12:23.077690 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['5f320f89-ada2-472d-b9ac-0676b4c4b578'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:12:23.109855 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['826848c6-a93a-4712-82dd-39e403bcb79e'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:12:23.156200 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['6596ca76-68f1-4ba1-ad74-a27f199ef442'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:12:23.513842 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0620496f-a14d-4836-9bf9-99d41ae9d7e0 req-790714c2-ea6a-401d-a9d9-ba8e7634c581 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:23.515328 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0620496f-a14d-4836-9bf9-99d41ae9d7e0 req-790714c2-ea6a-401d-a9d9-ba8e7634c581 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.1452553
Jun 01 06:12:23.523000 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80f160c4-2cd0-4211-9c16-bb5a765c9385 req-29a57476-3f9b-4fb5-9f3b-ab679b5ebfbf tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:23.524370 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-80f160c4-2cd0-4211-9c16-bb5a765c9385 req-29a57476-3f9b-4fb5-9f3b-ab679b5ebfbf tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 944 time: 0.1561632
Jun 01 06:12:23.596004 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0620496f-a14d-4836-9bf9-99d41ae9d7e0 req-e73b39a7-a031-4166-aff1-339ae071b4f4 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0706267
Jun 01 06:12:23.607559 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-80f160c4-2cd0-4211-9c16-bb5a765c9385 req-b58aa8e2-df22-4f95-bb3b-0c1173b712a8 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0669940
Jun 01 06:12:23.866684 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7421690b-22ac-40bb-b719-eb8de63da070 req-04b26d0d-45a1-496a-ba81-b628ed5c65a2 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:23.868861 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7421690b-22ac-40bb-b719-eb8de63da070 req-04b26d0d-45a1-496a-ba81-b628ed5c65a2 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 944 time: 0.1660373
Jun 01 06:12:23.881542 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a85b037-414c-4b60-b9b7-e6ebfc7b7b0f req-bcaec9b2-2c65-4c60-b012-44e87b276be6 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:23.883561 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0a85b037-414c-4b60-b9b7-e6ebfc7b7b0f req-bcaec9b2-2c65-4c60-b012-44e87b276be6 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.1347928
Jun 01 06:12:23.895948 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 60644) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:23.905507 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-3e248d4e-fd08-4144-9e8d-0d437e83b1ae tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Request body: {'floatingip': {'port_id': '42597738-974b-4af6-a799-e37d02b057b9'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:12:23.937234 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7421690b-22ac-40bb-b719-eb8de63da070 req-e59bc470-67d9-4cae-a4ac-419dca2d0c67 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0523412
Jun 01 06:12:23.993194 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 60650) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:24.043617 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3e248d4e-fd08-4144-9e8d-0d437e83b1ae tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for floatingip, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:24.111517 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62db5fb9-8d47-48ef-a234-2089053989d6 req-6ccaec28-724f-4838-b74c-02966096a3d8 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:24.121075 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-62db5fb9-8d47-48ef-a234-2089053989d6 req-6ccaec28-724f-4838-b74c-02966096a3d8 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/ports?device_id=b662816d-f3d5-434d-b2c3-eb501ac85556 HTTP/1.1" status: 200  len: 946 time: 0.1217926
Jun 01 06:12:24.216319 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-62db5fb9-8d47-48ef-a234-2089053989d6 req-2b19fa54-f65d-498b-9eef-a78fd74742b8 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/security-groups?id=322d6e24-5243-409c-8b80-acbe06176a3c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0936849
Jun 01 06:12:24.220616 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3ad05584-1348-4137-920d-dcc509dfd4c0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:24.247320 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-3ad05584-1348-4137-920d-dcc509dfd4c0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:24.252072 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-3ad05584-1348-4137-920d-dcc509dfd4c0 admin admin] Usage tracker for resource:security_group_rule and tenant:40f95521ad9645d5bb33064da31ced7c is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:24.255693 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-3ad05584-1348-4137-920d-dcc509dfd4c0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:24.263583 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-3ad05584-1348-4137-920d-dcc509dfd4c0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:24.355769 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3ad05584-1348-4137-920d-dcc509dfd4c0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:24.360246 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3ad05584-1348-4137-920d-dcc509dfd4c0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:24.369123 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:24.409144 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ad05584-1348-4137-920d-dcc509dfd4c0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3d43e1f9-3574-4652-b46c-85a6194b62b2,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:24.415876 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-3ad05584-1348-4137-920d-dcc509dfd4c0 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=40f95521ad9645d5bb33064da31ced7c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4188199
Jun 01 06:12:24.416557 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 60668) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:24.432284 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ad05584-1348-4137-920d-dcc509dfd4c0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:24.433736 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ad05584-1348-4137-920d-dcc509dfd4c0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:24.434355 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ad05584-1348-4137-920d-dcc509dfd4c0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:24.434742 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ad05584-1348-4137-920d-dcc509dfd4c0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:24.435330 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ad05584-1348-4137-920d-dcc509dfd4c0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:24.435703 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ad05584-1348-4137-920d-dcc509dfd4c0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:24.436151 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ad05584-1348-4137-920d-dcc509dfd4c0 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:24.436694 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ad05584-1348-4137-920d-dcc509dfd4c0 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:24.437210 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ad05584-1348-4137-920d-dcc509dfd4c0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:24.437534 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ad05584-1348-4137-920d-dcc509dfd4c0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:24.438440 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ad05584-1348-4137-920d-dcc509dfd4c0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:24.438875 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ad05584-1348-4137-920d-dcc509dfd4c0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:24.446360 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-3ad05584-1348-4137-920d-dcc509dfd4c0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:24.493750 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7682a4a7-68cc-4e15-92ea-e589e94ecfcf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:24.523675 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7682a4a7-68cc-4e15-92ea-e589e94ecfcf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:24.577966 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7682a4a7-68cc-4e15-92ea-e589e94ecfcf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:24.581927 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-9e52c4f3-4cc9-4595-8332-066f7d0fbf50 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:24.592750 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7682a4a7-68cc-4e15-92ea-e589e94ecfcf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3d43e1f9-3574-4652-b46c-85a6194b62b2,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:24.596279 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-7682a4a7-68cc-4e15-92ea-e589e94ecfcf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:24.599523 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7682a4a7-68cc-4e15-92ea-e589e94ecfcf admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:24.604210 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-7682a4a7-68cc-4e15-92ea-e589e94ecfcf admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/3d43e1f9-3574-4652-b46c-85a6194b62b2 HTTP/1.1" status: 204  len: 168 time: 0.1828699
Jun 01 06:12:24.814679 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d1568fe-39bf-4fc3-b659-b15e568edaca req-35f073b4-ecb1-4c43-8127-5ecf4b652d07 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:24.816191 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d1568fe-39bf-4fc3-b659-b15e568edaca req-35f073b4-ecb1-4c43-8127-5ecf4b652d07 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 944 time: 0.0854855
Jun 01 06:12:24.864406 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d1568fe-39bf-4fc3-b659-b15e568edaca req-fd985fb3-4383-4699-94e6-2d0407187102 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0423021
Jun 01 06:12:24.963414 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 60678) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:24.984148 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-a171b58b-3165-42dc-8e3c-5dba6edeb6f0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:25.002708 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-a171b58b-3165-42dc-8e3c-5dba6edeb6f0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:25.007051 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-a171b58b-3165-42dc-8e3c-5dba6edeb6f0 admin admin] Usage tracker for resource:security_group_rule and tenant:bcdd6ad980414560a14c1edf79b25500 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:25.009567 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-a171b58b-3165-42dc-8e3c-5dba6edeb6f0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:25.015623 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-a171b58b-3165-42dc-8e3c-5dba6edeb6f0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:25.020486 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3e248d4e-fd08-4144-9e8d-0d437e83b1ae tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:25.028985 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3e248d4e-fd08-4144-9e8d-0d437e83b1ae tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-745720'] for floatingip, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:25.114352 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-a171b58b-3165-42dc-8e3c-5dba6edeb6f0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:25.154185 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-a171b58b-3165-42dc-8e3c-5dba6edeb6f0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:25.169705 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-226199e3-ab07-4aa2-ac54-44443f1356a2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:25.216814 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.db.l3_db [None req-3e248d4e-fd08-4144-9e8d-0d437e83b1ae tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Floating IP 1b37b499-e96c-4dad-ad26-5ddaa7ba946f associated. External IP: 172.27.2.87, port: 42597738-974b-4af6-a799-e37d02b057b9.
Jun 01 06:12:25.231157 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-a171b58b-3165-42dc-8e3c-5dba6edeb6f0 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=bcdd6ad980414560a14c1edf79b25500&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2659883
Jun 01 06:12:25.234770 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 60692) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:25.237158 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a171b58b-3165-42dc-8e3c-5dba6edeb6f0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=82e74ddd-5f5e-4c58-ad6c-f1ee71d13e0c,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:25.266492 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-a171b58b-3165-42dc-8e3c-5dba6edeb6f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:25.295100 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e595de38-59e4-496e-be54-88c7510beecd req-aeec1968-9133-40a6-902b-8713aaab25d4 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:25.301073 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e595de38-59e4-496e-be54-88c7510beecd req-aeec1968-9133-40a6-902b-8713aaab25d4 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 944 time: 0.1851668
Jun 01 06:12:25.479486 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e595de38-59e4-496e-be54-88c7510beecd req-52c3c5ca-1c57-42db-9035-ac2300d044f2 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1744330
Jun 01 06:12:25.493401 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-2d014544-2162-4981-b5e0-0e6f6c666b79 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:25.555365 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-2d014544-2162-4981-b5e0-0e6f6c666b79 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:25.627183 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20bc6a38-6723-49d9-abbd-3586efda4906 req-ea265e31-e5a6-40aa-a2ec-9073b04c949a tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:25.628712 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-20bc6a38-6723-49d9-abbd-3586efda4906 req-ea265e31-e5a6-40aa-a2ec-9073b04c949a tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.48 "GET /v2.0/ports?device_id=b662816d-f3d5-434d-b2c3-eb501ac85556 HTTP/1.1" status: 200  len: 946 time: 0.3043165
Jun 01 06:12:25.682175 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd8ca7cc-d947-4b31-bca7-c2d5f1c68da7 req-e7715600-1462-4013-99b3-c998f9c19a03 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:25.684986 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bd8ca7cc-d947-4b31-bca7-c2d5f1c68da7 req-e7715600-1462-4013-99b3-c998f9c19a03 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/ports?device_id=b662816d-f3d5-434d-b2c3-eb501ac85556 HTTP/1.1" status: 200  len: 946 time: 0.2820284
Jun 01 06:12:25.751484 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-2d014544-2162-4981-b5e0-0e6f6c666b79 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:25.752558 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3e248d4e-fd08-4144-9e8d-0d437e83b1ae tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Router f8aef563-57d3-45c3-afd4-23442c8f572d has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92230) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:12:25.830788 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:25.866161 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-2d014544-2162-4981-b5e0-0e6f6c666b79 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:25.867710 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-2d014544-2162-4981-b5e0-0e6f6c666b79 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/82e74ddd-5f5e-4c58-ad6c-f1ee71d13e0c HTTP/1.1" status: 204  len: 168 time: 0.6319301
Jun 01 06:12:25.868835 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d014544-2162-4981-b5e0-0e6f6c666b79 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=82e74ddd-5f5e-4c58-ad6c-f1ee71d13e0c,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:25.883034 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-2d014544-2162-4981-b5e0-0e6f6c666b79 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:25.918959 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bd8ca7cc-d947-4b31-bca7-c2d5f1c68da7 req-3e3a10ac-8e9b-49d3-81c1-6be0c460874f tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/security-groups?id=322d6e24-5243-409c-8b80-acbe06176a3c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2143278
Jun 01 06:12:25.982453 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-20bc6a38-6723-49d9-abbd-3586efda4906 req-a154816f-b520-4061-88fc-430db063b471 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Deleting port dad38687-d35c-4b39-9dd6-26cb8f3ec5a7 {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:12:25.983089 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-20bc6a38-6723-49d9-abbd-3586efda4906 req-a154816f-b520-4061-88fc-430db063b471 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:25.999558 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3e248d4e-fd08-4144-9e8d-0d437e83b1ae tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:12:26.005584 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3e248d4e-fd08-4144-9e8d-0d437e83b1ae tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for floatingip, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:26.014743 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2b0612d-4451-4051-a984-60a18296ac73 None None] Sync routers for ids ['f8aef563-57d3-45c3-afd4-23442c8f572d'] in dv-cinder-793885-1-iscsi {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:12:26.034469 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2b0612d-4451-4051-a984-60a18296ac73 None None] Routers {'f8aef563-57d3-45c3-afd4-23442c8f572d'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:12:26.035236 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-b2b0612d-4451-4051-a984-60a18296ac73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b27e3580>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:12:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['f8aef563-57d3-45c3-afd4-23442c8f572d'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:12:26.156549 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-3e248d4e-fd08-4144-9e8d-0d437e83b1ae tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "PUT /v2.0/floatingips/1b37b499-e96c-4dad-ad26-5ddaa7ba946f HTTP/1.1" status: 200  len: 990 time: 2.2585771
Jun 01 06:12:26.157230 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'eb18f959-9e44-4148-a4fe-8f878905f76b', 'tag': '42597738-974b-4af6-a799-e37d02b057b9'}] {{(pid=92230) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:12:26.160082 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a8971187fdc179bafebfda031591b22633150c3ea1d9449252a7819502f19756" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c3abd859-cb5d-4f7e-afba-e2bfa786b0ff" -d '{"events": [{"name": "network-changed", "server_uuid": "eb18f959-9e44-4148-a4fe-8f878905f76b", "tag": "42597738-974b-4af6-a799-e37d02b057b9"}]}' {{(pid=92230) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:12:26.352808 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:12:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d48f471b-3b7f-4a1a-8e4f-3fa904596c8c x-openstack-request-id: req-d48f471b-3b7f-4a1a-8e4f-3fa904596c8c {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:12:26.353125 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "eb18f959-9e44-4148-a4fe-8f878905f76b", "tag": "42597738-974b-4af6-a799-e37d02b057b9", "status": "completed", "code": 200}]} {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:12:26.353399 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-d48f471b-3b7f-4a1a-8e4f-3fa904596c8c {{(pid=92230) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:12:26.353870 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'eb18f959-9e44-4148-a4fe-8f878905f76b', 'tag': '42597738-974b-4af6-a799-e37d02b057b9', 'status': 'completed', 'code': 200}
Jun 01 06:12:26.412172 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-b2b0612d-4451-4051-a984-60a18296ac73 None None] Set router f8aef563-57d3-45c3-afd4-23442c8f572d gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:12:26.507425 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 5f320f89-ada2-472d-b9ac-0676b4c4b578 up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:12:26.528365 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-20bc6a38-6723-49d9-abbd-3586efda4906 req-a154816f-b520-4061-88fc-430db063b471 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] For port dad38687-d35c-4b39-9dd6-26cb8f3ec5a7, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=dad38687-d35c-4b39-9dd6-26cb8f3ec5a7,segment=NetworkSegment(2ae86fef-efbf-4f06-98a8-03571bcdb7ca),segment_id=2ae86fef-efbf-4f06-98a8-03571bcdb7ca)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:12:26.528630 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-20bc6a38-6723-49d9-abbd-3586efda4906 req-a154816f-b520-4061-88fc-430db063b471 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:26.578054 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 60746) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:26.615798 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-83f37f76-266d-4a24-9756-b01b4244b2b8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:26.653871 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-83f37f76-266d-4a24-9756-b01b4244b2b8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:26.658402 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-83f37f76-266d-4a24-9756-b01b4244b2b8 admin admin] Usage tracker for resource:security_group_rule and tenant:2e9c62536e8849bb85a24400514ce5cf is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:26.661538 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-83f37f76-266d-4a24-9756-b01b4244b2b8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:26.664364 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning for port 5f320f89-ada2-472d-b9ac-0676b4c4b578 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:12:26.670429 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port 5f320f89-ada2-472d-b9ac-0676b4c4b578 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:12:26.671191 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:26.675235 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-83f37f76-266d-4a24-9756-b01b4244b2b8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:26.755982 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-20bc6a38-6723-49d9-abbd-3586efda4906 req-a154816f-b520-4061-88fc-430db063b471 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Calling delete_port for dad38687-d35c-4b39-9dd6-26cb8f3ec5a7 owned by compute:nova {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:12:26.796629 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-83f37f76-266d-4a24-9756-b01b4244b2b8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:26.801236 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-83f37f76-266d-4a24-9756-b01b4244b2b8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:26.812620 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-329cb82d-5310-43c7-a027-f4d1d0cfb882 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:26.816746 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:26.848322 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dc8bf0a9-503e-487c-975a-ec720e525cf1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5f320f89-ada2-472d-b9ac-0676b4c4b578'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:12:26.851111 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b640840d-f7ed-4aa8-9086-ba96a86db81d" -d '{"events": [{"server_uuid": "dc8bf0a9-503e-487c-975a-ec720e525cf1", "name": "network-vif-plugged", "status": "completed", "tag": "5f320f89-ada2-472d-b9ac-0676b4c4b578"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:12:26.861620 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 5f320f89-ada2-472d-b9ac-0676b4c4b578, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=5f320f89-ada2-472d-b9ac-0676b4c4b578,segment=NetworkSegment(1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e),segment_id=1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:12:26.865004 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-83f37f76-266d-4a24-9756-b01b4244b2b8 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=2e9c62536e8849bb85a24400514ce5cf&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2859395
Jun 01 06:12:26.866131 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f37f76-266d-4a24-9756-b01b4244b2b8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=945fbd3f-8f75-43a7-ac7e-a1e7f5805933,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:26.869750 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:26.871285 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 826848c6-a93a-4712-82dd-39e403bcb79e up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:12:26.874665 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 60754) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:26.876202 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f37f76-266d-4a24-9756-b01b4244b2b8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:26.876739 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f37f76-266d-4a24-9756-b01b4244b2b8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:26.877294 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f37f76-266d-4a24-9756-b01b4244b2b8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:26.877813 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f37f76-266d-4a24-9756-b01b4244b2b8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:26.878332 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f37f76-266d-4a24-9756-b01b4244b2b8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:26.878848 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f37f76-266d-4a24-9756-b01b4244b2b8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:26.879368 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f37f76-266d-4a24-9756-b01b4244b2b8 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:26.879914 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f37f76-266d-4a24-9756-b01b4244b2b8 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:26.880425 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f37f76-266d-4a24-9756-b01b4244b2b8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:26.880934 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f37f76-266d-4a24-9756-b01b4244b2b8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:26.881440 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f37f76-266d-4a24-9756-b01b4244b2b8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:26.881963 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f37f76-266d-4a24-9756-b01b4244b2b8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:26.887928 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-83f37f76-266d-4a24-9756-b01b4244b2b8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:26.909973 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:26.920784 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-593bd271-e888-4c3d-9bab-f8e418e272d0 req-91692029-ceab-484a-a99e-18d3a6f7e55c tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:26.922176 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-593bd271-e888-4c3d-9bab-f8e418e272d0 req-91692029-ceab-484a-a99e-18d3a6f7e55c tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 944 time: 0.6405287
Jun 01 06:12:26.929668 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3abd859-cb5d-4f7e-afba-e2bfa786b0ff req-c9654ae4-3dbf-428e-ab18-4a056dcb1271 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:26.931104 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c3abd859-cb5d-4f7e-afba-e2bfa786b0ff req-c9654ae4-3dbf-428e-ab18-4a056dcb1271 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=ac4006667c3442a3910d548e9e9d22c0&device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 1098 time: 0.5480006
Jun 01 06:12:26.961760 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-c30fbc8d-123e-4d06-aea2-a0497b0f4241 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:26.975520 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-b2b0612d-4451-4051-a984-60a18296ac73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b27e3580>, [{'id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'name': 'tempest-AttachVolumeTestJSON-1575365070-router', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214'}], 'enable_snat': True}, 'gw_port_id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:23Z', 'updated_at': '2021-06-01T06:11:31Z', 'revision_number': 4, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'gw_port': {'id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:02:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '1b37b499-e96c-4dad-ad26-5ddaa7ba946f', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'floating_ip_address': '172.27.2.87', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'port_id': '42597738-974b-4af6-a799-e37d02b057b9', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 120, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'mac_address': 'fa:16:3e:11:73:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb18f959-9e44-4148-a4fe-8f878905f76b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:11:50Z', 'updated_at': '2021-06-01T06:12:24Z', 'revision_number': 1, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8e48657d-a82c-420f-8462-d947f458adb4', 'name': '', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'mac_address': 'fa:16:3e:9f:72:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '3e980239-de35-45a0-8039-8395b5408617', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:30Z', 'updated_at': '2021-06-01T06:11:46Z', 'revision_number': 5, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'subnets': [{'id': '3e980239-de35-45a0-8039-8395b5408617', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:12:26.981294 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2b0612d-4451-4051-a984-60a18296ac73 None None] Checking router: f8aef563-57d3-45c3-afd4-23442c8f572d for host: dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:12:26.994687 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2b0612d-4451-4051-a984-60a18296ac73 None None] Routers {'f8aef563-57d3-45c3-afd4-23442c8f572d'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:12:26.995999 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-b2b0612d-4451-4051-a984-60a18296ac73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b27e3580>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:12:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['f8aef563-57d3-45c3-afd4-23442c8f572d'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:12:26.997697 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-c30fbc8d-123e-4d06-aea2-a0497b0f4241 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:27.011960 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=5f320f89-ada2-472d-b9ac-0676b4c4b578,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:27.015720 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:27.025863 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning for port 826848c6-a93a-4712-82dd-39e403bcb79e completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:12:27.032212 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port 826848c6-a93a-4712-82dd-39e403bcb79e triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:12:27.032835 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:27.065571 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-c30fbc8d-123e-4d06-aea2-a0497b0f4241 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:27.069668 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-46f9ae93-d6b7-4c01-81a7-99c0dda8922d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:27.089623 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c30fbc8d-123e-4d06-aea2-a0497b0f4241 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=945fbd3f-8f75-43a7-ac7e-a1e7f5805933,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:27.092089 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-c30fbc8d-123e-4d06-aea2-a0497b0f4241 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:27.095939 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-c30fbc8d-123e-4d06-aea2-a0497b0f4241 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/945fbd3f-8f75-43a7-ac7e-a1e7f5805933 HTTP/1.1" status: 204  len: 168 time: 0.2079091
Jun 01 06:12:27.095939 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-c30fbc8d-123e-4d06-aea2-a0497b0f4241 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:27.114798 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-593bd271-e888-4c3d-9bab-f8e418e272d0 req-e5254d7b-a155-4b62-aacb-106f872282d6 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1721702
Jun 01 06:12:27.165017 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a32474e0-bf79-4a24-89b1-e9fa1c792e56 req-e4873df2-cf09-4216-9a3a-e7743b5831a1 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:27.165017 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a32474e0-bf79-4a24-89b1-e9fa1c792e56 req-e4873df2-cf09-4216-9a3a-e7743b5831a1 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 944 time: 0.4876885
Jun 01 06:12:27.217639 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:27.227567 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-20bc6a38-6723-49d9-abbd-3586efda4906 req-a154816f-b520-4061-88fc-430db063b471 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:27.238494 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-907ebe46-b106-4923-9880-06ca8cd4a7ec tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:27.243522 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['dad38687-d35c-4b39-9dd6-26cb8f3ec5a7'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:12:27.307050 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a32474e0-bf79-4a24-89b1-e9fa1c792e56 req-6f2f6376-552f-4a1c-bf70-cf116a8fa9ab tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1432807
Jun 01 06:12:27.335468 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 826848c6-a93a-4712-82dd-39e403bcb79e, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=826848c6-a93a-4712-82dd-39e403bcb79e,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:12:27.351349 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:27.352421 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 6596ca76-68f1-4ba1-ad74-a27f199ef442 up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:12:27.394034 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a154816f-b520-4061-88fc-430db063b471 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Pushing event deleted for resources: {'Port': ['ID=dad38687-d35c-4b39-9dd6-26cb8f3ec5a7,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:27.415580 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-b2b0612d-4451-4051-a984-60a18296ac73 None None] Set router f8aef563-57d3-45c3-afd4-23442c8f572d gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:12:27.427218 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:27.477459 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-a154816f-b520-4061-88fc-430db063b471 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:27.492385 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3abd859-cb5d-4f7e-afba-e2bfa786b0ff req-c06d03b0-41ee-4b2e-85d7-2e745ad00a3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:27.500554 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c3abd859-cb5d-4f7e-afba-e2bfa786b0ff req-c06d03b0-41ee-4b2e-85d7-2e745ad00a3c service neutron] 10.222.0.48 "GET /v2.0/networks?id=0890ab9c-2266-4ef4-af73-d3ff421b9bd7 HTTP/1.1" status: 200  len: 912 time: 0.5264182
Jun 01 06:12:27.554866 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:12:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b84152f9-38d2-4126-bf66-ccd0e2a65ded x-openstack-request-id: req-b84152f9-38d2-4126-bf66-ccd0e2a65ded {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:12:27.555840 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dc8bf0a9-503e-487c-975a-ec720e525cf1", "name": "network-vif-plugged", "status": "completed", "tag": "5f320f89-ada2-472d-b9ac-0676b4c4b578", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:12:27.556360 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-b84152f9-38d2-4126-bf66-ccd0e2a65ded {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:12:27.556901 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dc8bf0a9-503e-487c-975a-ec720e525cf1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5f320f89-ada2-472d-b9ac-0676b4c4b578', 'code': 200}
Jun 01 06:12:27.566425 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=826848c6-a93a-4712-82dd-39e403bcb79e,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:27.608392 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:27.608941 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:27.609459 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:27.610482 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:27.611754 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:27.612346 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:27.613381 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:27.614012 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:27.614506 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:27.615090 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:27.615539 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:27.616013 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:12:27.622166 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.195s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:27.653851 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning for port 6596ca76-68f1-4ba1-ad74-a27f199ef442 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:12:27.664290 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port 6596ca76-68f1-4ba1-ad74-a27f199ef442 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:12:27.664955 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:27.892007 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-20bc6a38-6723-49d9-abbd-3586efda4906 req-a154816f-b520-4061-88fc-430db063b471 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] No DVR routers for this DVR port dad38687-d35c-4b39-9dd6-26cb8f3ec5a7 on host hv-cinder-79388 {{(pid=92229) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:12:27.963487 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ee1488f1-ca0a-41bd-9171-30bbf3732e8c req-20c62211-7e7e-40b2-88a3-67e4fc9e2080 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.25 "GET /v2.0/ports?device_id=b662816d-f3d5-434d-b2c3-eb501ac85556 HTTP/1.1" status: 200  len: 210 time: 0.1170707
Jun 01 06:12:27.970499 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-20bc6a38-6723-49d9-abbd-3586efda4906 req-a154816f-b520-4061-88fc-430db063b471 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:27.973407 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b662816d-f3d5-434d-b2c3-eb501ac85556', 'name': 'network-vif-deleted', 'tag': 'dad38687-d35c-4b39-9dd6-26cb8f3ec5a7'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:12:27.976440 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9f436518-1523-4d2f-84bf-cf27e00158e0" -d '{"events": [{"server_uuid": "b662816d-f3d5-434d-b2c3-eb501ac85556", "name": "network-vif-deleted", "tag": "dad38687-d35c-4b39-9dd6-26cb8f3ec5a7"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:12:28.040665 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-20bc6a38-6723-49d9-abbd-3586efda4906 req-a154816f-b520-4061-88fc-430db063b471 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] 10.222.0.48 "DELETE /v2.0/ports/dad38687-d35c-4b39-9dd6-26cb8f3ec5a7 HTTP/1.1" status: 204  len: 173 time: 2.4020493
Jun 01 06:12:28.081417 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c3abd859-cb5d-4f7e-afba-e2bfa786b0ff req-0c19d3a3-8201-42c5-a02e-4cef55503742 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=42597738-974b-4af6-a799-e37d02b057b9 HTTP/1.1" status: 200  len: 998 time: 0.3782802
Jun 01 06:12:28.105759 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:28.143305 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-b2b0612d-4451-4051-a984-60a18296ac73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b27e3580>, [{'id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'name': 'tempest-AttachVolumeTestJSON-1575365070-router', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214'}], 'enable_snat': True}, 'gw_port_id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:23Z', 'updated_at': '2021-06-01T06:11:31Z', 'revision_number': 4, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'gw_port': {'id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:02:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '1b37b499-e96c-4dad-ad26-5ddaa7ba946f', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'floating_ip_address': '172.27.2.87', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'port_id': '42597738-974b-4af6-a799-e37d02b057b9', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 120, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'mac_address': 'fa:16:3e:11:73:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb18f959-9e44-4148-a4fe-8f878905f76b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:11:50Z', 'updated_at': '2021-06-01T06:12:24Z', 'revision_number': 1, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8e48657d-a82c-420f-8462-d947f458adb4', 'name': '', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'mac_address': 'fa:16:3e:9f:72:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '3e980239-de35-45a0-8039-8395b5408617', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:30Z', 'updated_at': '2021-06-01T06:11:46Z', 'revision_number': 5, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'subnets': [{'id': '3e980239-de35-45a0-8039-8395b5408617', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:12:28.150068 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2b0612d-4451-4051-a984-60a18296ac73 None None] The sync data for ids ['f8aef563-57d3-45c3-afd4-23442c8f572d'] in dv-cinder-793885-1-iscsi is: [{'id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'name': 'tempest-AttachVolumeTestJSON-1575365070-router', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214'}], 'enable_snat': True}, 'gw_port_id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:23Z', 'updated_at': '2021-06-01T06:11:31Z', 'revision_number': 4, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'gw_port': {'id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:02:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '1b37b499-e96c-4dad-ad26-5ddaa7ba946f', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'floating_ip_address': '172.27.2.87', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'port_id': '42597738-974b-4af6-a799-e37d02b057b9', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 120, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'mac_address': 'fa:16:3e:11:73:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eb18f959-9e44-4148-a4fe-8f878905f76b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:11:50Z', 'updated_at': '2021-06-01T06:12:24Z', 'revision_number': 1, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8e48657d-a82c-420f-8462-d947f458adb4', 'name': '', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'mac_address': 'fa:16:3e:9f:72:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '3e980239-de35-45a0-8039-8395b5408617', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:30Z', 'updated_at': '2021-06-01T06:11:46Z', 'revision_number': 5, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'subnets': [{'id': '3e980239-de35-45a0-8039-8395b5408617', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:12:28.185687 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 6596ca76-68f1-4ba1-ad74-a27f199ef442, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=6596ca76-68f1-4ba1-ad74-a27f199ef442,segment=NetworkSegment(1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e),segment_id=1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:12:28.190952 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f806d7e1-e72b-460b-aeef-f4d34119e510 req-d1f333b3-73cc-478a-b0ee-1a6fc02deb71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:28.193529 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-f806d7e1-e72b-460b-aeef-f4d34119e510 req-d1f333b3-73cc-478a-b0ee-1a6fc02deb71 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 1098 time: 0.3936820
Jun 01 06:12:28.195305 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:28.197447 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:28.247087 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-92c0d08a-84d5-480d-9c63-0d848271f53f tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:28.254570 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-92c0d08a-84d5-480d-9c63-0d848271f53f tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/networks?id=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 HTTP/1.1" status: 200  len: 814 time: 0.8946862
Jun 01 06:12:28.283270 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-cf54f28e-941c-471d-a3d5-d6e4a4d41cba tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/quotas/b02068c8f29e4f5e9b3c965d023f7e29 HTTP/1.1" status: 200  len: 375 time: 0.0275660
Jun 01 06:12:28.290195 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3abd859-cb5d-4f7e-afba-e2bfa786b0ff req-685516da-9bb3-4b0f-9078-cc8f34cc8b7f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:28.291626 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c3abd859-cb5d-4f7e-afba-e2bfa786b0ff req-685516da-9bb3-4b0f-9078-cc8f34cc8b7f service neutron] 10.222.0.48 "GET /v2.0/subnets?id=3e980239-de35-45a0-8039-8395b5408617 HTTP/1.1" status: 200  len: 850 time: 0.1798811
Jun 01 06:12:28.311294 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-f806d7e1-e72b-460b-aeef-f4d34119e510 req-eb7c8da8-4140-412f-a296-9fe34221e738 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1076729
Jun 01 06:12:28.344448 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=6596ca76-68f1-4ba1-ad74-a27f199ef442,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:28.367450 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:12:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fcdc6772-c648-4ecf-9592-e2b6572ace27 x-openstack-request-id: req-fcdc6772-c648-4ecf-9592-e2b6572ace27 {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:12:28.367752 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b662816d-f3d5-434d-b2c3-eb501ac85556", "name": "network-vif-deleted", "tag": "dad38687-d35c-4b39-9dd6-26cb8f3ec5a7", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:12:28.368044 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-fcdc6772-c648-4ecf-9592-e2b6572ace27 {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:12:28.368447 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b662816d-f3d5-434d-b2c3-eb501ac85556', 'name': 'network-vif-deleted', 'tag': 'dad38687-d35c-4b39-9dd6-26cb8f3ec5a7', 'status': 'completed', 'code': 200}
Jun 01 06:12:28.374620 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:28.592763 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4530ff86-db4f-4239-8c12-fa521204663b None None] New status for floating IP 1b37b499-e96c-4dad-ad26-5ddaa7ba946f: ACTIVE {{(pid=92231) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 06:12:28.655369 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3abd859-cb5d-4f7e-afba-e2bfa786b0ff req-4a6069f8-91f7-4abc-b7cd-a7d91d877c50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:28.656865 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c3abd859-cb5d-4f7e-afba-e2bfa786b0ff req-4a6069f8-91f7-4abc-b7cd-a7d91d877c50 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=0890ab9c-2266-4ef4-af73-d3ff421b9bd7&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2913003
Jun 01 06:12:28.665779 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-268bee16-7530-4347-9fb6-05d19e848041 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=b02068c8f29e4f5e9b3c965d023f7e29&fields=id HTTP/1.1" status: 200  len: 255 time: 0.3815498
Jun 01 06:12:28.890302 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-bafea7a9-2715-4501-bb17-8198cb77af4b service neutron] 10.222.0.25 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1375527
Jun 01 06:12:29.062827 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32e2abab-bb1e-4274-a69c-4428929d9103 req-29b16666-c201-4927-9367-94619f1a79b1 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:29.069774 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-32e2abab-bb1e-4274-a69c-4428929d9103 req-29b16666-c201-4927-9367-94619f1a79b1 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.5792456
Jun 01 06:12:29.090384 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c3abd859-cb5d-4f7e-afba-e2bfa786b0ff req-4edeac5b-02f5-48fe-aca7-f502f67fdc9b service neutron] 10.222.0.48 "GET /v2.0/networks/0890ab9c-2266-4ef4-af73-d3ff421b9bd7?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4147890
Jun 01 06:12:29.259515 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 60838) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:29.435374 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0d6b4f75-2cdc-4e9a-9d8a-edec9f4c998a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:29.455652 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-0d6b4f75-2cdc-4e9a-9d8a-edec9f4c998a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:29.460347 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-0d6b4f75-2cdc-4e9a-9d8a-edec9f4c998a admin admin] Usage tracker for resource:security_group_rule and tenant:d02efe086ac44cd5b1b89aef521cda75 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:29.465895 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-0d6b4f75-2cdc-4e9a-9d8a-edec9f4c998a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:29.472632 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-0d6b4f75-2cdc-4e9a-9d8a-edec9f4c998a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:29.489603 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-ca13f026-2d1d-459d-9cf6-a6cfc7b1e353 service neutron] 10.222.0.25 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5860813
Jun 01 06:12:29.507847 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-32e2abab-bb1e-4274-a69c-4428929d9103 req-710a2016-1902-4ee2-901e-f692636a095c tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4342768
Jun 01 06:12:29.515894 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c3abd859-cb5d-4f7e-afba-e2bfa786b0ff req-12b0a2d2-2cd9-4b73-9c10-6003e8352054 service neutron] 10.222.0.48 "GET /v2.0/networks/0890ab9c-2266-4ef4-af73-d3ff421b9bd7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3928561
Jun 01 06:12:29.558581 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1385f5c8-2a7a-45b1-a982-6f897700aa17', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '826848c6-a93a-4712-82dd-39e403bcb79e'}, {'server_uuid': '72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6596ca76-68f1-4ba1-ad74-a27f199ef442'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:12:29.561430 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eeff8599-90b0-4449-a516-31d6ce73d177" -d '{"events": [{"server_uuid": "1385f5c8-2a7a-45b1-a982-6f897700aa17", "name": "network-vif-plugged", "status": "completed", "tag": "826848c6-a93a-4712-82dd-39e403bcb79e"}, {"server_uuid": "72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a", "name": "network-vif-plugged", "status": "completed", "tag": "6596ca76-68f1-4ba1-ad74-a27f199ef442"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:12:29.636174 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0d6b4f75-2cdc-4e9a-9d8a-edec9f4c998a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:29.642074 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0d6b4f75-2cdc-4e9a-9d8a-edec9f4c998a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:29.674482 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-5210747f-718c-4019-ada8-cfeb46ccbcb8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:29.684349 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-0d6b4f75-2cdc-4e9a-9d8a-edec9f4c998a admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=d02efe086ac44cd5b1b89aef521cda75&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4233792
Jun 01 06:12:29.686925 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 60860) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:29.783847 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d6b4f75-2cdc-4e9a-9d8a-edec9f4c998a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f103403a-f2d6-4046-b658-2669e87a1bca,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:29.788091 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-0d6b4f75-2cdc-4e9a-9d8a-edec9f4c998a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:29.831851 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9e8d946-5191-4201-87ae-99212e1520d6 req-db5dba97-bd07-4407-a712-2ccdd43b13c0 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:29.835992 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b9e8d946-5191-4201-87ae-99212e1520d6 req-db5dba97-bd07-4407-a712-2ccdd43b13c0 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.1759000
Jun 01 06:12:29.932093 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-908c7e27-a137-4b71-8a30-c4cbd9a76e52 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:29.932265 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b9e8d946-5191-4201-87ae-99212e1520d6 req-b11ae600-e1aa-44c4-8942-6aaab5bff51a tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0898314
Jun 01 06:12:30.002045 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-908c7e27-a137-4b71-8a30-c4cbd9a76e52 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:30.018875 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Tue, 01 Jun 2021 06:12:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-29b14f14-7ebe-4598-b9f5-cec6a4463cff x-openstack-request-id: req-29b14f14-7ebe-4598-b9f5-cec6a4463cff {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:12:30.019375 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1385f5c8-2a7a-45b1-a982-6f897700aa17", "name": "network-vif-plugged", "status": "completed", "tag": "826848c6-a93a-4712-82dd-39e403bcb79e", "code": 200}, {"server_uuid": "72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a", "name": "network-vif-plugged", "status": "completed", "tag": "6596ca76-68f1-4ba1-ad74-a27f199ef442", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:12:30.019489 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-29b14f14-7ebe-4598-b9f5-cec6a4463cff {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:12:30.019903 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1385f5c8-2a7a-45b1-a982-6f897700aa17', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '826848c6-a93a-4712-82dd-39e403bcb79e', 'code': 200}
Jun 01 06:12:30.020171 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6596ca76-68f1-4ba1-ad74-a27f199ef442', 'code': 200}
Jun 01 06:12:30.129741 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8fb1df51-304f-42a9-82d6-e91aa1009489 req-93425bf8-99ee-4c09-a392-9ced2454fa2f tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=66ffd6b4-021c-479c-bc48-aa35c8846786 HTTP/1.1" status: 200  len: 210 time: 0.0859897
Jun 01 06:12:30.136080 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-908c7e27-a137-4b71-8a30-c4cbd9a76e52 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:30.140389 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-c30fbc8d-123e-4d06-aea2-a0497b0f4241 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:30.181763 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-908c7e27-a137-4b71-8a30-c4cbd9a76e52 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f103403a-f2d6-4046-b658-2669e87a1bca,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:30.197535 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-908c7e27-a137-4b71-8a30-c4cbd9a76e52 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:30.200100 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-908c7e27-a137-4b71-8a30-c4cbd9a76e52 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:30.205217 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-908c7e27-a137-4b71-8a30-c4cbd9a76e52 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/f103403a-f2d6-4046-b658-2669e87a1bca HTTP/1.1" status: 204  len: 168 time: 0.4957283
Jun 01 06:12:30.425688 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8b2fb39-8fa6-4f76-b5a0-a2ea11fc49c0 req-7dc0ef85-c2ca-43cd-8c1c-43c3a49a0306 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:30.429906 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-e8b2fb39-8fa6-4f76-b5a0-a2ea11fc49c0 req-7dc0ef85-c2ca-43cd-8c1c-43c3a49a0306 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 1098 time: 0.1142235
Jun 01 06:12:30.482554 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ac78898-320c-486b-8f90-7f78af57ab09 req-06fc8df0-3587-49b7-8785-6a639c9882b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:30.484087 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6ac78898-320c-486b-8f90-7f78af57ab09 req-06fc8df0-3587-49b7-8785-6a639c9882b8 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 1098 time: 0.1685584
Jun 01 06:12:30.515451 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-e8b2fb39-8fa6-4f76-b5a0-a2ea11fc49c0 req-26e1e482-1137-414f-bd2a-215f2af766c3 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0775423
Jun 01 06:12:30.546948 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device dad38687-d35c-4b39-9dd6-26cb8f3ec5a7 no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:12:30.627010 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6ac78898-320c-486b-8f90-7f78af57ab09 req-bf92acc7-79dc-434b-836f-df761d3b0463 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1353843
Jun 01 06:12:30.648205 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] No Port match for: dad38687-d35c-4b39-9dd6-26cb8f3ec5a7 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:12:30.648651 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device dad38687-d35c-4b39-9dd6-26cb8f3ec5a7 not bound to the agent host hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:12:30.804337 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9681762d-b88b-40d8-99c8-68c718fbd94c req-7a6d55c3-f039-43ba-b315-10d79914f5c9 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:30.805952 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9681762d-b88b-40d8-99c8-68c718fbd94c req-7a6d55c3-f039-43ba-b315-10d79914f5c9 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.1144567
Jun 01 06:12:30.827878 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 60922) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:30.848771 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8f2fe24c-2269-45d7-922f-84e03d953cd6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:30.868602 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-8f2fe24c-2269-45d7-922f-84e03d953cd6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:30.869372 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9681762d-b88b-40d8-99c8-68c718fbd94c req-1d88206b-48cd-4d24-a9a8-9e6d48a0b088 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0560279
Jun 01 06:12:30.874300 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-8f2fe24c-2269-45d7-922f-84e03d953cd6 admin admin] Usage tracker for resource:security_group_rule and tenant:c2cfcec3322940b18ecb034556c2c606 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:30.878991 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-8f2fe24c-2269-45d7-922f-84e03d953cd6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:30.885708 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-8f2fe24c-2269-45d7-922f-84e03d953cd6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:30.985964 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8f2fe24c-2269-45d7-922f-84e03d953cd6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:30.991706 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8f2fe24c-2269-45d7-922f-84e03d953cd6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:31.003329 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:31.031667 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-8f2fe24c-2269-45d7-922f-84e03d953cd6 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=c2cfcec3322940b18ecb034556c2c606&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2026038
Jun 01 06:12:31.034341 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 60934) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:31.077225 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f2fe24c-2269-45d7-922f-84e03d953cd6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=41cb236c-5540-4b22-8a5e-5bc4fcff08c6,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:31.082372 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-8f2fe24c-2269-45d7-922f-84e03d953cd6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:31.114437 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d365ed93-bae8-40cf-a6c2-1ce22224ebcf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:31.146347 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 60942) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:31.159946 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d365ed93-bae8-40cf-a6c2-1ce22224ebcf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:31.203634 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6b9d238-58a4-44a0-aa3c-ece8b21a8a6a req-e87b77f4-93b8-4653-ac12-695eb562e863 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:31.205314 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a6b9d238-58a4-44a0-aa3c-ece8b21a8a6a req-e87b77f4-93b8-4653-ac12-695eb562e863 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.1128409
Jun 01 06:12:31.233427 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d365ed93-bae8-40cf-a6c2-1ce22224ebcf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:31.242534 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:31.255414 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d365ed93-bae8-40cf-a6c2-1ce22224ebcf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=41cb236c-5540-4b22-8a5e-5bc4fcff08c6,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:31.257862 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-d365ed93-bae8-40cf-a6c2-1ce22224ebcf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:31.278884 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d365ed93-bae8-40cf-a6c2-1ce22224ebcf admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:31.279222 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a6b9d238-58a4-44a0-aa3c-ece8b21a8a6a req-c5d333e2-56c9-4d62-8a0a-8dc554c37cfe tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0678222
Jun 01 06:12:31.280049 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-d365ed93-bae8-40cf-a6c2-1ce22224ebcf admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/41cb236c-5540-4b22-8a5e-5bc4fcff08c6 HTTP/1.1" status: 204  len: 168 time: 0.2447834
Jun 01 06:12:31.357626 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-67eb12ce-6cab-46cd-8257-c8dda6428b8b admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:31.376180 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-67eb12ce-6cab-46cd-8257-c8dda6428b8b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:31.384101 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-67eb12ce-6cab-46cd-8257-c8dda6428b8b admin admin] Usage tracker for resource:security_group_rule and tenant:9cd8c52974ca4affa669fa0c8bb076d6 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:31.390079 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-67eb12ce-6cab-46cd-8257-c8dda6428b8b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:31.396333 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-67eb12ce-6cab-46cd-8257-c8dda6428b8b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:31.422260 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e24197a4-941d-45b5-982e-aeb6d53f9d58 req-09415176-240a-4047-b0ee-66e27b4abe2c tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=66ffd6b4-021c-479c-bc48-aa35c8846786 HTTP/1.1" status: 200  len: 210 time: 0.0909231
Jun 01 06:12:31.534248 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-67eb12ce-6cab-46cd-8257-c8dda6428b8b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:31.541608 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-67eb12ce-6cab-46cd-8257-c8dda6428b8b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:31.555482 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-6398b1f8-11f6-4647-96a1-7aebafb78dc8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:31.592761 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67eb12ce-6cab-46cd-8257-c8dda6428b8b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cc3e715d-6af3-4ba7-a027-a05f42725ee3,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:31.596521 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-67eb12ce-6cab-46cd-8257-c8dda6428b8b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:31.627818 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-67eb12ce-6cab-46cd-8257-c8dda6428b8b admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=9cd8c52974ca4affa669fa0c8bb076d6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4800863
Jun 01 06:12:31.628551 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 60956) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:31.718082 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d90baf75-b8ac-4fee-b73b-33cb7691faf7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:31.771268 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d90baf75-b8ac-4fee-b73b-33cb7691faf7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:31.790059 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-a43b147d-9282-482e-a46f-94e79e42487d tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:31.793105 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-a43b147d-9282-482e-a46f-94e79e42487d tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.48 "GET /v2.0/networks?id=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 HTTP/1.1" status: 200  len: 814 time: 0.2856133
Jun 01 06:12:31.814339 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-9a881612-5f00-497c-9efd-87541a7c2702 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Request body: {'port': {'device_id': '66ffd6b4-021c-479c-bc48-aa35c8846786', 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6', 'admin_state_up': True, 'tenant_id': 'b02068c8f29e4f5e9b3c965d023f7e29'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:12:31.848201 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d90baf75-b8ac-4fee-b73b-33cb7691faf7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:31.854125 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-6806bea2-9071-4c7e-b736-f3d3ad55edc8 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:31.880100 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d90baf75-b8ac-4fee-b73b-33cb7691faf7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc3e715d-6af3-4ba7-a027-a05f42725ee3,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:31.885283 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-d90baf75-b8ac-4fee-b73b-33cb7691faf7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:31.906151 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d90baf75-b8ac-4fee-b73b-33cb7691faf7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:31.912674 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-d90baf75-b8ac-4fee-b73b-33cb7691faf7 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/cc3e715d-6af3-4ba7-a027-a05f42725ee3 HTTP/1.1" status: 204  len: 168 time: 0.2822552
Jun 01 06:12:32.181425 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-9a881612-5f00-497c-9efd-87541a7c2702 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:32.196868 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-9a881612-5f00-497c-9efd-87541a7c2702 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:32.227994 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 60992) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:32.228361 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-645c8555-b1fc-4747-b748-cc41541e5743 req-cb6caa27-83ab-42f2-b4de-5541ccb3bb64 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:32.230961 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-645c8555-b1fc-4747-b748-cc41541e5743 req-cb6caa27-83ab-42f2-b4de-5541ccb3bb64 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.1410375
Jun 01 06:12:32.231947 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-9a881612-5f00-497c-9efd-87541a7c2702 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Made reservation on behalf of b02068c8f29e4f5e9b3c965d023f7e29 for: {'port': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:12:32.235318 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-9a881612-5f00-497c-9efd-87541a7c2702 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:32.357245 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_v2 [None req-7d7204fd-620a-4c7a-9c27-597554988a54 admin admin] Deleting subnet 5d7e3531-6a32-40da-9550-2584d9bd4210 {{(pid=92230) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 06:12:32.360524 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7d7204fd-620a-4c7a-9c27-597554988a54 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:32.366334 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-645c8555-b1fc-4747-b748-cc41541e5743 req-0583df6d-6489-49ac-83c9-79e6ebae728d tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1143749
Jun 01 06:12:32.437080 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7d7204fd-620a-4c7a-9c27-597554988a54 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:32.444573 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7d7204fd-620a-4c7a-9c27-597554988a54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8086245'] for subnet, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:32.590122 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 32774) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:32.636116 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 32782) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:32.680824 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-5623736c-d660-4c84-9129-a6969ec0b0a2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:32.712946 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-5623736c-d660-4c84-9129-a6969ec0b0a2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:32.749544 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-5623736c-d660-4c84-9129-a6969ec0b0a2 admin admin] Usage tracker for resource:security_group_rule and tenant:32c400dda7324ae0b7872595096d32ca is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:32.752565 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-5623736c-d660-4c84-9129-a6969ec0b0a2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:32.758516 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-5623736c-d660-4c84-9129-a6969ec0b0a2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:32.797589 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-9a881612-5f00-497c-9efd-87541a7c2702 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Allocated IP 172.20.0.5 (8c37e9ed-7031-4d7f-bfd1-3763eabba1b6/52a5c0c8-e902-4e55-bfa8-495f043331da/b83de976-8a2a-4caf-b3a4-4f2d2016ddd4) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:12:32.837736 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d14eeaa4-8015-4120-abd8-77dff41f3f09 req-cb92dd8c-7faa-4eb4-8ceb-a703c283e958 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=66ffd6b4-021c-479c-bc48-aa35c8846786 HTTP/1.1" status: 200  len: 210 time: 0.0868256
Jun 01 06:12:32.849086 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7d7204fd-620a-4c7a-9c27-597554988a54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8087120', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099'] for subnet, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:32.871820 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:32.908479 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ee78dd5-e44d-4793-ace1-08b2e1384e60 req-99de9b31-fe6e-4a7c-b06b-5fbe0a9cecb5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:32.908619 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7d7204fd-620a-4c7a-9c27-597554988a54 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:32.915559 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9ee78dd5-e44d-4793-ace1-08b2e1384e60 req-99de9b31-fe6e-4a7c-b06b-5fbe0a9cecb5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.4151275
Jun 01 06:12:32.915729 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d7204fd-620a-4c7a-9c27-597554988a54 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5d7e3531-6a32-40da-9550-2584d9bd4210,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:32.926282 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-7d7204fd-620a-4c7a-9c27-597554988a54 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:32.959115 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-7d7204fd-620a-4c7a-9c27-597554988a54 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/5d7e3531-6a32-40da-9550-2584d9bd4210 HTTP/1.1" status: 204  len: 168 time: 0.7298987
Jun 01 06:12:32.962921 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 32790) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:32.966195 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-68ccbcc1-7433-47d4-a827-450acd5e5392 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:33.018319 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-68ccbcc1-7433-47d4-a827-450acd5e5392 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:33.023112 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-5623736c-d660-4c84-9129-a6969ec0b0a2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:33.055195 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9ee78dd5-e44d-4793-ace1-08b2e1384e60 req-1cdff028-de55-44a7-a918-145121494d54 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1387389
Jun 01 06:12:33.071536 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-68ccbcc1-7433-47d4-a827-450acd5e5392 admin admin] Usage tracker for resource:security_group_rule and tenant:ad70f60964804b35966c9ee259eecb0c is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:33.087082 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-5623736c-d660-4c84-9129-a6969ec0b0a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:33.098754 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-68ccbcc1-7433-47d4-a827-450acd5e5392 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:33.101453 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e348349d-8b42-4700-a340-f81dc2c88432 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:33.116592 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-68ccbcc1-7433-47d4-a827-450acd5e5392 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:33.145540 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-9a881612-5f00-497c-9efd-87541a7c2702 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:33.176300 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-5623736c-d660-4c84-9129-a6969ec0b0a2 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=32c400dda7324ae0b7872595096d32ca&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5387621
Jun 01 06:12:33.178950 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8063377'] for network, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:33.179392 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 32802) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:33.196285 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5623736c-d660-4c84-9129-a6969ec0b0a2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1d1b28ad-eecd-4d7a-b8c2-74a606a8806e,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:33.200806 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-9a881612-5f00-497c-9efd-87541a7c2702 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:33.204205 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-5623736c-d660-4c84-9129-a6969ec0b0a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:33.212487 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b5d5216d-5168-4fec-8c43-a491f1bdb62f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:33.215465 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['de8f02a4-b74f-47df-a797-bc3cbe7be366'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:12:33.351112 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-9a881612-5f00-497c-9efd-87541a7c2702 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Network 8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:12:33.368755 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-9a881612-5f00-497c-9efd-87541a7c2702 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:12:33.372254 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-9a881612-5f00-497c-9efd-87541a7c2702 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:12:33.378504 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-9a881612-5f00-497c-9efd-87541a7c2702 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:33.379412 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-9a881612-5f00-497c-9efd-87541a7c2702 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:33.425898 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-68ccbcc1-7433-47d4-a827-450acd5e5392 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:33.430290 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8093290', 'neutron.services.segments.db._delete_segments_for_network-8788497006300'] for network, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:33.443263 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-68ccbcc1-7433-47d4-a827-450acd5e5392 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:33.456733 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-9a881612-5f00-497c-9efd-87541a7c2702 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.6484811
Jun 01 06:12:33.456985 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-cab96cb6-c8cf-46fb-a04e-ecb044dc0866 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:33.476621 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7fe3b1d31190>> segment before_delete 55550000 {{(pid=92230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:12:33.477123 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7fe3b1d31190>> subnet precommit_delete_associations 55550000 {{(pid=92230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:12:33.477995 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe3b195e5b0>> segment_host_mapping after_create 55550000 {{(pid=92230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:12:33.478644 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe3b195e5b0>> port after_create 55550000 {{(pid=92230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:12:33.479629 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe3b195e5b0>> port after_delete 55550000 {{(pid=92230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:12:33.480148 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe3b195e5b0>> port after_update 55550000 {{(pid=92230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:12:33.480648 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe3b195e5b0>> segment after_delete 55550000 {{(pid=92230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:12:33.481505 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe3b195e5b0>> subnet after_create 55550000 {{(pid=92230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:12:33.481973 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe3b195e5b0>> subnet after_delete 55550000 {{(pid=92230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:12:33.482455 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe3b195e5b0>> subnet after_update 55550000 {{(pid=92230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:12:33.497760 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Request body: {'port': {'device_id': '66ffd6b4-021c-479c-bc48-aa35c8846786', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79388'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:12:33.528650 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a881612-5f00-497c-9efd-87541a7c2702 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Pushing event updated for resources: {'Port': ['ID=b83de976-8a2a-4caf-b3a4-4f2d2016ddd4,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:33.543902 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-9a881612-5f00-497c-9efd-87541a7c2702 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.331s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:33.551817 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fe3b23bcca0>> subnet after_create 55550000 {{(pid=92230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:12:33.552186 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fe3b23bcca0>> subnet after_delete 55550000 {{(pid=92230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:12:33.552683 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fe3b23bcca0>> subnet before_create 55550000 {{(pid=92230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:12:33.553021 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fe3b23bcca0>> subnet before_update 55550000 {{(pid=92230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:12:33.553383 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe3b2190280>,) {'filters': {'network_id': ['a3095bbd-0ae1-463e-b1b5-d29b58112d63']}} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:12:33.591440 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b2190280>, '2ae86fef-efbf-4f06-98a8-03571bcdb7ca') {'for_net_delete': True} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:12:33.592161 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b2190280>, '2ae86fef-efbf-4f06-98a8-03571bcdb7ca') {} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:12:33.600363 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-68ccbcc1-7433-47d4-a827-450acd5e5392 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=ad70f60964804b35966c9ee259eecb0c&name=default HTTP/1.1" status: 200  len: 2979 time: 1.0091646
Jun 01 06:12:33.601429 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68ccbcc1-7433-47d4-a827-450acd5e5392 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=779e0cab-9f4e-4a31-9061-2f9473b5b00c,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:33.604785 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 32816) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:33.610969 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-68ccbcc1-7433-47d4-a827-450acd5e5392 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:33.622084 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8788497014941', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2178892'] for segment, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:33.639539 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-710b02cf-780a-451e-856c-15d906098f79 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:33.651741 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:33.669881 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Releasing vlan 233 on physical network physnet1 to pool {{(pid=92230) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 06:12:33.670277 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2416152'] for segment, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:   from cryptography.utils import int_from_bytes
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:   from cryptography.utils import int_from_bytes
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]: Traceback (most recent call last):
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:     timer()
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:     cb(*args, **kw)
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:     return func(*args, **kwargs)
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:     self._notify()
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:     self.callback(batched_events)
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:     event.method(event)
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:     return f(self, *a, **k)
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self._get(url).json()
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self.request(url, 'GET', **kwargs)
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 06:12:33.686558 dv-cinder-793885-1-iscsi neutron-server[92230]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 06:12:33.750133 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-710b02cf-780a-451e-856c-15d906098f79 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:33.783081 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca3e486c-00c7-455c-a1c4-c54266ca79fa req-d1898cc6-ed53-4c6e-a3ff-d40b2ea0c245 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:33.785353 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ca3e486c-00c7-455c-a1c4-c54266ca79fa req-d1898cc6-ed53-4c6e-a3ff-d40b2ea0c245 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.5886462
Jun 01 06:12:33.808561 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:33.830474 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 32826) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:33.864395 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-547120ad-a5d8-492e-b8e2-1b4f0a5ad9d2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:33.894926 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-096ba520-27a2-4333-969e-ea189be10fee tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Request body: {'floatingip': {'port_id': '826848c6-a93a-4712-82dd-39e403bcb79e'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:12:33.918979 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c495ff3-ffdb-40c3-aa9c-d0272e2c1092 req-52f779bd-0961-4e28-bb0d-3a195f762cf3 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:33.920559 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5c495ff3-ffdb-40c3-aa9c-d0272e2c1092 req-52f779bd-0961-4e28-bb0d-3a195f762cf3 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.3798985
Jun 01 06:12:33.985046 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-547120ad-a5d8-492e-b8e2-1b4f0a5ad9d2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:34.001385 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-096ba520-27a2-4333-969e-ea189be10fee tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for floatingip, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:34.098956 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8093283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-745674'] for network, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:34.112086 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5c495ff3-ffdb-40c3-aa9c-d0272e2c1092 req-ed83de91-7c27-4eab-a3e1-172b52a09dcd tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0920153
Jun 01 06:12:34.127868 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:34.146393 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:34.244127 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Pushing event deleted for resources: {'Network': ['ID=a3095bbd-0ae1-463e-b1b5-d29b58112d63,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:34.247357 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:34.271198 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] 10.222.0.25 "DELETE /v2.0/networks/a3095bbd-0ae1-463e-b1b5-d29b58112d63 HTTP/1.1" status: 204  len: 168 time: 1.3064249
Jun 01 06:12:34.279148 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-710b02cf-780a-451e-856c-15d906098f79 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:34.293236 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:34.318454 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-710b02cf-780a-451e-856c-15d906098f79 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1d1b28ad-eecd-4d7a-b8c2-74a606a8806e,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:34.326588 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-710b02cf-780a-451e-856c-15d906098f79 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:34.341277 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-547120ad-a5d8-492e-b8e2-1b4f0a5ad9d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:34.348749 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-d365ed93-bae8-40cf-a6c2-1ce22224ebcf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:34.368160 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-710b02cf-780a-451e-856c-15d906098f79 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:34.373403 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-710b02cf-780a-451e-856c-15d906098f79 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/1d1b28ad-eecd-4d7a-b8c2-74a606a8806e HTTP/1.1" status: 204  len: 168 time: 1.1919699
Jun 01 06:12:34.373634 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-547120ad-a5d8-492e-b8e2-1b4f0a5ad9d2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=779e0cab-9f4e-4a31-9061-2f9473b5b00c,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:34.376393 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-547120ad-a5d8-492e-b8e2-1b4f0a5ad9d2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:34.387547 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-547120ad-a5d8-492e-b8e2-1b4f0a5ad9d2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:34.391548 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-547120ad-a5d8-492e-b8e2-1b4f0a5ad9d2 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/779e0cab-9f4e-4a31-9061-2f9473b5b00c HTTP/1.1" status: 204  len: 168 time: 0.7836807
Jun 01 06:12:34.422911 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de14d465-a514-45a0-b4b1-43e0a940c6df req-94415f02-5602-4629-b582-e0e192bd0c03 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:34.423645 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-de14d465-a514-45a0-b4b1-43e0a940c6df req-94415f02-5602-4629-b582-e0e192bd0c03 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Synchronizing usage tracker for tenant:b02068c8f29e4f5e9b3c965d023f7e29 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:12:34.428879 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 32852) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:34.469242 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-de14d465-a514-45a0-b4b1-43e0a940c6df req-94415f02-5602-4629-b582-e0e192bd0c03 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Unset dirty status for tenant:b02068c8f29e4f5e9b3c965d023f7e29 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:12:34.476221 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-de14d465-a514-45a0-b4b1-43e0a940c6df req-94415f02-5602-4629-b582-e0e192bd0c03 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=66ffd6b4-021c-479c-bc48-aa35c8846786 HTTP/1.1" status: 200  len: 931 time: 0.2684476
Jun 01 06:12:34.579982 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b83de976-8a2a-4caf-b3a4-4f2d2016ddd4 {{(pid=92229) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:12:34.596154 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-de14d465-a514-45a0-b4b1-43e0a940c6df req-3e903231-b4dd-4884-909d-104cf203c719 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1186213
Jun 01 06:12:34.606522 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:34.675775 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 32860) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:34.678179 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Transition to ACTIVE for port object b83de976-8a2a-4caf-b3a4-4f2d2016ddd4 will not be triggered until provisioned by entity L2. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:12:34.709631 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:34.722280 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-52400227-abe3-491b-8c94-c9641b7a5def service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:34.795510 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Pushing event updated for resources: {'Port': ['ID=b83de976-8a2a-4caf-b3a4-4f2d2016ddd4,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:34.837041 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4214efac-76ed-4d87-8d82-e375c4758761 req-6d434749-2223-432e-8a6c-7712b3f042b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:34.838616 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-4214efac-76ed-4d87-8d82-e375c4758761 req-6d434749-2223-432e-8a6c-7712b3f042b9 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=8f1cf739e243401eb5da7ee705e856de&device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 1098 time: 0.2111940
Jun 01 06:12:34.856982 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:34.973022 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-01b30df1-2846-4020-8dbc-ab11dd2e5ab0 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=1e84732645d04c3dae887b1b3847cffe&name=default HTTP/1.1" status: 200  len: 2975 time: 0.2972491
Jun 01 06:12:34.980229 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 32870) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:34.982710 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-64aefdf1-93b7-46c8-99bc-e833903896f4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:35.032209 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4214efac-76ed-4d87-8d82-e375c4758761 req-dfaa588e-8402-4bf2-9c87-2b51f17c9151 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:35.032209 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-4214efac-76ed-4d87-8d82-e375c4758761 req-dfaa588e-8402-4bf2-9c87-2b51f17c9151 service neutron] 10.222.0.48 "GET /v2.0/networks?id=6e45a0e5-f930-4b18-8f4f-1693815eb31a HTTP/1.1" status: 200  len: 919 time: 0.1735277
Jun 01 06:12:35.085057 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-64aefdf1-93b7-46c8-99bc-e833903896f4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:35.089679 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-64aefdf1-93b7-46c8-99bc-e833903896f4 admin admin] Usage tracker for resource:security_group_rule and tenant:bb81d0d4f3d5468e8a49b1d885204454 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:35.092705 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-64aefdf1-93b7-46c8-99bc-e833903896f4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:35.101470 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-64aefdf1-93b7-46c8-99bc-e833903896f4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:35.113560 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Attempting to bind port b83de976-8a2a-4caf-b3a4-4f2d2016ddd4 on host hv-cinder-79388 for vnic_type normal with profile  {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:12:35.114209 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Attempting to bind port b83de976-8a2a-4caf-b3a4-4f2d2016ddd4 by drivers openvswitch,hyperv on host hv-cinder-79388 at level 0 using segments [{'id': '7e12089c-d8cc-429c-8b7b-f5d148a55957', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 206, 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6'}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:12:35.114209 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Attempting to bind port b83de976-8a2a-4caf-b3a4-4f2d2016ddd4 on network 8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:12:35.115807 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-4214efac-76ed-4d87-8d82-e375c4758761 req-e3c3ab8e-15d8-4bcb-bc95-f8bc68ad11ee service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=6596ca76-68f1-4ba1-ad74-a27f199ef442 HTTP/1.1" status: 200  len: 217 time: 0.0759332
Jun 01 06:12:35.130162 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84bcf399-3af0-423d-8665-b5aab45edac6 req-18991f9c-e984-4047-9f47-8521ee74a477 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:35.138001 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-84bcf399-3af0-423d-8665-b5aab45edac6 req-18991f9c-e984-4047-9f47-8521ee74a477 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.5281508
Jun 01 06:12:35.169427 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Port b83de976-8a2a-4caf-b3a4-4f2d2016ddd4 on network 8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79388 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 06:12:35.169729 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Attempting to bind port b83de976-8a2a-4caf-b3a4-4f2d2016ddd4 on network 8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:12:35.195586 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Checking agent: {'id': '56148394-2131-4d06-bcfa-c032301591b8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79388', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'started_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 12, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:12:35.195941 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Checking segment: {'id': '7e12089c-d8cc-429c-8b7b-f5d148a55957', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 206, 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:12:35.196311 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Bound using segment: {'id': '7e12089c-d8cc-429c-8b7b-f5d148a55957', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 206, 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6'} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:12:35.196945 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Bound port: b83de976-8a2a-4caf-b3a4-4f2d2016ddd4, host: hv-cinder-79388, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7e12089c-d8cc-429c-8b7b-f5d148a55957', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 206, 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6'}}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:12:35.197069 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:35.285617 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 32882) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:35.300474 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-84bcf399-3af0-423d-8665-b5aab45edac6 req-55d87bfd-0a21-4db6-b43c-dd76a662f97d tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1615460
Jun 01 06:12:35.325220 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e6c00cea-74be-4da2-a6e8-a575d282a66c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:35.343290 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4214efac-76ed-4d87-8d82-e375c4758761 req-010629ff-c74f-443d-a6bc-00fa4b0efa60 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:35.345597 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-4214efac-76ed-4d87-8d82-e375c4758761 req-010629ff-c74f-443d-a6bc-00fa4b0efa60 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=84c296fc-69c0-46e2-b1ed-e3edf435b759 HTTP/1.1" status: 200  len: 858 time: 0.2195323
Jun 01 06:12:35.377795 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-c4da7997-205a-42b9-9e97-085fd37b9491 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:35.405292 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e6c00cea-74be-4da2-a6e8-a575d282a66c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:35.409780 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] For port b83de976-8a2a-4caf-b3a4-4f2d2016ddd4, host hv-cinder-79388, cleared binding levels {{(pid=92229) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:12:35.413649 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-4214efac-76ed-4d87-8d82-e375c4758761 req-cb157df0-f89c-4be6-a2b7-6139f52968c1 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=6e45a0e5-f930-4b18-8f4f-1693815eb31a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0546956
Jun 01 06:12:35.414924 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e6c00cea-74be-4da2-a6e8-a575d282a66c admin admin] Usage tracker for resource:security_group_rule and tenant:85fb00f2666049bc971fd6b727a7740d is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:35.419942 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-096ba520-27a2-4333-969e-ea189be10fee tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:35.421142 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e6c00cea-74be-4da2-a6e8-a575d282a66c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:35.429515 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e6c00cea-74be-4da2-a6e8-a575d282a66c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:35.442709 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-64aefdf1-93b7-46c8-99bc-e833903896f4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:35.444784 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] For port b83de976-8a2a-4caf-b3a4-4f2d2016ddd4, host hv-cinder-79388, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=b83de976-8a2a-4caf-b3a4-4f2d2016ddd4,segment=NetworkSegment(7e12089c-d8cc-429c-8b7b-f5d148a55957),segment_id=7e12089c-d8cc-429c-8b7b-f5d148a55957)] {{(pid=92229) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:12:35.446688 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-c4da7997-205a-42b9-9e97-085fd37b9491 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:35.452037 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-096ba520-27a2-4333-969e-ea189be10fee tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-745720'] for floatingip, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:35.457755 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:35.461887 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-64aefdf1-93b7-46c8-99bc-e833903896f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:35.472728 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:35.579135 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:35.580042 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:35.581518 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] 10.222.0.48 "PUT /v2.0/ports/b83de976-8a2a-4caf-b3a4-4f2d2016ddd4 HTTP/1.1" status: 200  len: 1093 time: 2.0996571
Jun 01 06:12:35.582152 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '66ffd6b4-021c-479c-bc48-aa35c8846786', 'tag': 'b83de976-8a2a-4caf-b3a4-4f2d2016ddd4'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:12:35.584894 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d62ae09a-03cd-4447-989e-b9e7ee426602" -d '{"events": [{"name": "network-changed", "server_uuid": "66ffd6b4-021c-479c-bc48-aa35c8846786", "tag": "b83de976-8a2a-4caf-b3a4-4f2d2016ddd4"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:12:35.598442 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-64aefdf1-93b7-46c8-99bc-e833903896f4 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=bb81d0d4f3d5468e8a49b1d885204454&name=default HTTP/1.1" status: 200  len: 2979 time: 1.1684847
Jun 01 06:12:35.605302 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 32894) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:35.705065 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:12:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eced16ac-36f2-417d-82ec-2eddf1ba5412 x-openstack-request-id: req-eced16ac-36f2-417d-82ec-2eddf1ba5412 {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:12:35.705683 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "66ffd6b4-021c-479c-bc48-aa35c8846786", "tag": "b83de976-8a2a-4caf-b3a4-4f2d2016ddd4", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:12:35.706106 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-eced16ac-36f2-417d-82ec-2eddf1ba5412 {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:12:35.706818 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '66ffd6b4-021c-479c-bc48-aa35c8846786', 'tag': 'b83de976-8a2a-4caf-b3a4-4f2d2016ddd4', 'status': 'completed', 'code': 200}
Jun 01 06:12:35.810880 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Pushing event updated for resources: {'Port': ['ID=b83de976-8a2a-4caf-b3a4-4f2d2016ddd4,revision_number=3']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:35.836752 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.364s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:35.843252 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.db.l3_db [None req-096ba520-27a2-4333-969e-ea189be10fee tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Floating IP 8639dc42-b15e-4dfb-b648-ca0a9c38fd05 associated. External IP: 172.27.2.242, port: 826848c6-a93a-4712-82dd-39e403bcb79e.
Jun 01 06:12:35.845344 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.344s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:35.852408 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b76ba254-6de0-4716-8524-72d4f249d099 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:35.858349 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-c4da7997-205a-42b9-9e97-085fd37b9491 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:35.926921 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b76ba254-6de0-4716-8524-72d4f249d099 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:35.936830 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64aefdf1-93b7-46c8-99bc-e833903896f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e9916f6c-b6d3-4fc6-816e-a4e0b17310c2,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:35.939974 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-64aefdf1-93b7-46c8-99bc-e833903896f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:35.946419 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.071s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:35.959822 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-4214efac-76ed-4d87-8d82-e375c4758761 req-3966bc80-ee08-4c0f-a980-4b48225d606a service neutron] 10.222.0.48 "GET /v2.0/networks/6e45a0e5-f930-4b18-8f4f-1693815eb31a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5318830
Jun 01 06:12:35.976549 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4da7997-205a-42b9-9e97-085fd37b9491 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=322d6e24-5243-409c-8b80-acbe06176a3c,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:35.978907 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-c4da7997-205a-42b9-9e97-085fd37b9491 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:35.983652 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-c4da7997-205a-42b9-9e97-085fd37b9491 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:35.992138 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-c4da7997-205a-42b9-9e97-085fd37b9491 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/322d6e24-5243-409c-8b80-acbe06176a3c HTTP/1.1" status: 204  len: 168 time: 1.0069149
Jun 01 06:12:36.036346 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-99af6e8a-ff30-44fa-a339-dcb60d3e3cb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:36.038244 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-99af6e8a-ff30-44fa-a339-dcb60d3e3cb0 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=b02068c8f29e4f5e9b3c965d023f7e29&device_id=66ffd6b4-021c-479c-bc48-aa35c8846786 HTTP/1.1" status: 200  len: 1096 time: 0.3817666
Jun 01 06:12:36.055584 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2a3dd37-6424-4106-b63b-50cbe3f5fb36 req-444fc39d-f0c9-49a9-8071-fae0d600132f tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:36.064075 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c2a3dd37-6424-4106-b63b-50cbe3f5fb36 req-444fc39d-f0c9-49a9-8071-fae0d600132f tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=66ffd6b4-021c-479c-bc48-aa35c8846786 HTTP/1.1" status: 200  len: 943 time: 0.3118651
Jun 01 06:12:36.168166 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-f676bc7f-17f8-4ffe-8421-eb50a68b2571 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=b83de976-8a2a-4caf-b3a4-4f2d2016ddd4 HTTP/1.1" status: 200  len: 217 time: 0.0887966
Jun 01 06:12:36.226501 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b76ba254-6de0-4716-8524-72d4f249d099 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:36.239024 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:36.274547 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c2a3dd37-6424-4106-b63b-50cbe3f5fb36 req-c01ffba3-df9f-4365-ba86-aac2edb1b448 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2092478
Jun 01 06:12:36.294631 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e6c00cea-74be-4da2-a6e8-a575d282a66c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:36.299026 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e6c00cea-74be-4da2-a6e8-a575d282a66c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:36.314344 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-662a0e8b-66db-41e0-adab-78e556fe19ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:36.317748 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-662a0e8b-66db-41e0-adab-78e556fe19ce service neutron] 10.222.0.48 "GET /v2.0/subnets?id=52a5c0c8-e902-4e55-bfa8-495f043331da HTTP/1.1" status: 200  len: 854 time: 0.1371350
Jun 01 06:12:36.319831 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b76ba254-6de0-4716-8524-72d4f249d099 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e9916f6c-b6d3-4fc6-816e-a4e0b17310c2,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:36.322022 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-68ccbcc1-7433-47d4-a827-450acd5e5392 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:36.323524 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b76ba254-6de0-4716-8524-72d4f249d099 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:36.325176 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b76ba254-6de0-4716-8524-72d4f249d099 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:36.342666 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-b76ba254-6de0-4716-8524-72d4f249d099 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/e9916f6c-b6d3-4fc6-816e-a4e0b17310c2 HTTP/1.1" status: 204  len: 168 time: 0.7300527
Jun 01 06:12:36.372946 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-4214efac-76ed-4d87-8d82-e375c4758761 req-2545dc27-3212-4805-8558-6c96b04eb4e0 service neutron] 10.222.0.48 "GET /v2.0/networks/6e45a0e5-f930-4b18-8f4f-1693815eb31a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3471820
Jun 01 06:12:36.410609 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-d1cba348-513f-48ef-9a21-9aea946a26df service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0667927
Jun 01 06:12:36.411138 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 32920) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:36.445555 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6c00cea-74be-4da2-a6e8-a575d282a66c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=69a3a553-d2ac-4bab-ac79-326ac1c50b13,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:36.458415 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e6c00cea-74be-4da2-a6e8-a575d282a66c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:36.462231 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-e6c00cea-74be-4da2-a6e8-a575d282a66c admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=85fb00f2666049bc971fd6b727a7740d&name=default HTTP/1.1" status: 200  len: 2979 time: 1.1794412
Jun 01 06:12:36.473377 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 32928) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:36.564599 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-096ba520-27a2-4333-969e-ea189be10fee tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Router b7bdc21e-592c-4bbf-87c9-5eba5676579e has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92230) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:12:36.570093 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7be685f5-5a27-40bf-b8ec-707959729478 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:36.681368 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7be685f5-5a27-40bf-b8ec-707959729478 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:36.720062 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-517df092-6bf5-4b67-b341-6158735e04d0 service neutron] 10.222.0.48 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2922740
Jun 01 06:12:36.734496 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-713730b3-ad41-4e23-b6f3-679bd0a7ddd8 req-78ea291e-8eac-4785-87d3-3fad1e5027c5 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:36.736167 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-713730b3-ad41-4e23-b6f3-679bd0a7ddd8 req-78ea291e-8eac-4785-87d3-3fad1e5027c5 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.1509476
Jun 01 06:12:36.818808 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-096ba520-27a2-4333-969e-ea189be10fee tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:12:36.834706 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d053a7ae-978e-4d6f-b5c1-12ceed0d9a05 None None] Sync routers for ids ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'] in dv-cinder-793885-1-iscsi {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:12:36.852040 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d053a7ae-978e-4d6f-b5c1-12ceed0d9a05 None None] Routers {'b7bdc21e-592c-4bbf-87c9-5eba5676579e'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:12:36.852250 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-096ba520-27a2-4333-969e-ea189be10fee tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for floatingip, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:36.853639 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-d053a7ae-978e-4d6f-b5c1-12ceed0d9a05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b27e33a0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:12:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:12:36.884534 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7be685f5-5a27-40bf-b8ec-707959729478 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:36.887280 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7be685f5-5a27-40bf-b8ec-707959729478 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:36.890778 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-7be685f5-5a27-40bf-b8ec-707959729478 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/69a3a553-d2ac-4bab-ac79-326ac1c50b13 HTTP/1.1" status: 204  len: 168 time: 0.4138682
Jun 01 06:12:36.895512 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-5623736c-d660-4c84-9129-a6969ec0b0a2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:36.897881 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4dd3de13-20c1-485d-a988-80ba8161894b admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:36.916234 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7be685f5-5a27-40bf-b8ec-707959729478 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=69a3a553-d2ac-4bab-ac79-326ac1c50b13,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:36.918707 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-713730b3-ad41-4e23-b6f3-679bd0a7ddd8 req-903f9b6c-05eb-444f-9e4c-22f940e09652 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1594839
Jun 01 06:12:36.921626 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-7be685f5-5a27-40bf-b8ec-707959729478 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:36.931359 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-096ba520-27a2-4333-969e-ea189be10fee tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "PUT /v2.0/floatingips/8639dc42-b15e-4dfb-b648-ca0a9c38fd05 HTTP/1.1" status: 200  len: 991 time: 3.0690670
Jun 01 06:12:36.931359 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1385f5c8-2a7a-45b1-a982-6f897700aa17', 'tag': '826848c6-a93a-4712-82dd-39e403bcb79e'}] {{(pid=92230) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:12:36.932061 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a8971187fdc179bafebfda031591b22633150c3ea1d9449252a7819502f19756" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e28ff956-2b0e-47d8-ad31-6fc8b6654ca5" -d '{"events": [{"name": "network-changed", "server_uuid": "1385f5c8-2a7a-45b1-a982-6f897700aa17", "tag": "826848c6-a93a-4712-82dd-39e403bcb79e"}]}' {{(pid=92230) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:12:36.976134 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-4dd3de13-20c1-485d-a988-80ba8161894b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:36.992199 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 32948) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:37.021720 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e031269b-5e5c-4748-a192-c293d8d3fc6e admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:37.030267 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-4dd3de13-20c1-485d-a988-80ba8161894b admin admin] Usage tracker for resource:security_group_rule and tenant:e5cdb7aa0e334f59a2a38e4615cd2d8e is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:37.042830 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-4dd3de13-20c1-485d-a988-80ba8161894b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:37.057815 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-4dd3de13-20c1-485d-a988-80ba8161894b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:37.069009 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-95a0a760-2cfe-4d8d-863f-f06aed975810 req-b163e84d-e03a-4f7e-8fb9-c2177f783df6 service neutron] 10.222.0.48 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3317235
Jun 01 06:12:37.069489 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:12:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d2066bff-114d-4580-b64e-d9142dadaca5 x-openstack-request-id: req-d2066bff-114d-4580-b64e-d9142dadaca5 {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:12:37.069794 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1385f5c8-2a7a-45b1-a982-6f897700aa17", "tag": "826848c6-a93a-4712-82dd-39e403bcb79e", "status": "completed", "code": 200}]} {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:12:37.070060 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-d2066bff-114d-4580-b64e-d9142dadaca5 {{(pid=92230) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:12:37.070469 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1385f5c8-2a7a-45b1-a982-6f897700aa17', 'tag': '826848c6-a93a-4712-82dd-39e403bcb79e', 'status': 'completed', 'code': 200}
Jun 01 06:12:37.072262 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e031269b-5e5c-4748-a192-c293d8d3fc6e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:37.076717 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e031269b-5e5c-4748-a192-c293d8d3fc6e admin admin] Usage tracker for resource:security_group_rule and tenant:c3561c4f64f64b058af354332e53f547 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:37.090646 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e031269b-5e5c-4748-a192-c293d8d3fc6e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:37.108226 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e031269b-5e5c-4748-a192-c293d8d3fc6e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:37.262512 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4dd3de13-20c1-485d-a988-80ba8161894b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:37.268635 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e28ff956-2b0e-47d8-ad31-6fc8b6654ca5 req-f758b877-250e-4856-9271-9eb095df30d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:37.270124 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-d053a7ae-978e-4d6f-b5c1-12ceed0d9a05 None None] Set router b7bdc21e-592c-4bbf-87c9-5eba5676579e gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:12:37.271000 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e28ff956-2b0e-47d8-ad31-6fc8b6654ca5 req-f758b877-250e-4856-9271-9eb095df30d1 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=0f63ca6fed3e47a6a676979240aef5c0&device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 1098 time: 0.1407132
Jun 01 06:12:37.272999 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4dd3de13-20c1-485d-a988-80ba8161894b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:37.283052 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-3ad05584-1348-4137-920d-dcc509dfd4c0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:37.355834 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d62ae09a-03cd-4447-989e-b9e7ee426602 req-756ea788-e6f9-4ccc-a6e9-0373a451d0af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:37.357408 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-d62ae09a-03cd-4447-989e-b9e7ee426602 req-756ea788-e6f9-4ccc-a6e9-0373a451d0af service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=b02068c8f29e4f5e9b3c965d023f7e29&device_id=66ffd6b4-021c-479c-bc48-aa35c8846786 HTTP/1.1" status: 200  len: 1096 time: 0.1987615
Jun 01 06:12:37.362516 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e031269b-5e5c-4748-a192-c293d8d3fc6e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:37.427572 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e031269b-5e5c-4748-a192-c293d8d3fc6e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:37.455556 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e6c00cea-74be-4da2-a6e8-a575d282a66c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:37.483307 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dd3de13-20c1-485d-a988-80ba8161894b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=634dfdf2-42a8-404f-805f-ed52cdef658a,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:37.492519 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-4dd3de13-20c1-485d-a988-80ba8161894b admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=e5cdb7aa0e334f59a2a38e4615cd2d8e&name=default HTTP/1.1" status: 200  len: 2979 time: 1.0773733
Jun 01 06:12:37.530914 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 32962) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:37.533950 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e031269b-5e5c-4748-a192-c293d8d3fc6e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d0d33043-addb-4737-a310-3d8ca96c9ff6,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:37.583000 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-4dd3de13-20c1-485d-a988-80ba8161894b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.300s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:37.668558 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 32970) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:37.702076 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-f393c50e-158f-4b04-b5bd-ac20af5bd1b2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:37.713740 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e031269b-5e5c-4748-a192-c293d8d3fc6e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.258s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:37.766376 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-f393c50e-158f-4b04-b5bd-ac20af5bd1b2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:37.775584 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-e031269b-5e5c-4748-a192-c293d8d3fc6e admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=c3561c4f64f64b058af354332e53f547&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7799706
Jun 01 06:12:37.776446 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 32976) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:37.779772 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-f393c50e-158f-4b04-b5bd-ac20af5bd1b2 admin admin] Usage tracker for resource:security_group_rule and tenant:933fcca3132c45049e1757fdfc41e367 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:37.784985 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e28ff956-2b0e-47d8-ad31-6fc8b6654ca5 req-8db4b882-d80a-43b9-8fea-c7f693d04549 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:37.786441 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e28ff956-2b0e-47d8-ad31-6fc8b6654ca5 req-8db4b882-d80a-43b9-8fea-c7f693d04549 service neutron] 10.222.0.48 "GET /v2.0/networks?id=5f973ed4-521b-4b78-9a54-1336b1302fa2 HTTP/1.1" status: 200  len: 917 time: 0.4654043
Jun 01 06:12:37.787221 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-f393c50e-158f-4b04-b5bd-ac20af5bd1b2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:37.811028 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-f393c50e-158f-4b04-b5bd-ac20af5bd1b2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:37.830683 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-03a2dc0b-3b98-48ad-9e4e-70b0609b1de0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:37.879983 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d62ae09a-03cd-4447-989e-b9e7ee426602 req-5370ce2b-ed19-424e-a5c4-69551fdab3fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:37.881507 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-d62ae09a-03cd-4447-989e-b9e7ee426602 req-5370ce2b-ed19-424e-a5c4-69551fdab3fe service neutron] 10.222.0.48 "GET /v2.0/networks?id=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 HTTP/1.1" status: 200  len: 915 time: 0.5146897
Jun 01 06:12:37.886829 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-03a2dc0b-3b98-48ad-9e4e-70b0609b1de0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:37.958363 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-d053a7ae-978e-4d6f-b5c1-12ceed0d9a05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b27e33a0>, [{'id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'name': 'tempest-AttachVolumeShelveTestJSON-921884409-router', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20'}], 'enable_snat': True}, 'gw_port_id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:24Z', 'updated_at': '2021-06-01T06:11:44Z', 'revision_number': 4, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'gw_port': {'id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:b4:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:27Z', 'updated_at': '2021-06-01T06:11:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '8639dc42-b15e-4dfb-b648-ca0a9c38fd05', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'floating_ip_address': '172.27.2.242', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'port_id': '826848c6-a93a-4712-82dd-39e403bcb79e', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 127, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'mac_address': 'fa:16:3e:c4:14:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1385f5c8-2a7a-45b1-a982-6f897700aa17', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:11:54Z', 'updated_at': '2021-06-01T06:12:35Z', 'revision_number': 1, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '47f62b29-867e-4af1-9330-02c97cb95473', 'name': '', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'mac_address': 'fa:16:3e:8c:f8:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:39Z', 'updated_at': '2021-06-01T06:11:57Z', 'revision_number': 5, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'subnets': [{'id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:12:37.962291 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-d62ae09a-03cd-4447-989e-b9e7ee426602 req-35f7ab43-0921-41f3-8ed4-92b858fa53e5 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=b83de976-8a2a-4caf-b3a4-4f2d2016ddd4 HTTP/1.1" status: 200  len: 217 time: 0.0682991
Jun 01 06:12:37.965065 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d053a7ae-978e-4d6f-b5c1-12ceed0d9a05 None None] Checking router: b7bdc21e-592c-4bbf-87c9-5eba5676579e for host: dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:12:37.994247 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d053a7ae-978e-4d6f-b5c1-12ceed0d9a05 None None] Routers {'b7bdc21e-592c-4bbf-87c9-5eba5676579e'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:12:37.995500 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-d053a7ae-978e-4d6f-b5c1-12ceed0d9a05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b27e33a0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:12:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:12:38.017236 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e28ff956-2b0e-47d8-ad31-6fc8b6654ca5 req-97c49031-0216-428b-b36f-4517d17c00ab service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=826848c6-a93a-4712-82dd-39e403bcb79e HTTP/1.1" status: 200  len: 999 time: 0.2161324
Jun 01 06:12:38.051724 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d62ae09a-03cd-4447-989e-b9e7ee426602 req-dd47ddcf-baf6-4e2e-9e67-2be2a9d459df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:38.053178 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-d62ae09a-03cd-4447-989e-b9e7ee426602 req-dd47ddcf-baf6-4e2e-9e67-2be2a9d459df service neutron] 10.222.0.48 "GET /v2.0/subnets?id=52a5c0c8-e902-4e55-bfa8-495f043331da HTTP/1.1" status: 200  len: 854 time: 0.0823264
Jun 01 06:12:38.116956 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-03a2dc0b-3b98-48ad-9e4e-70b0609b1de0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:38.127873 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-7be685f5-5a27-40bf-b8ec-707959729478 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:38.144670 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03a2dc0b-3b98-48ad-9e4e-70b0609b1de0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=634dfdf2-42a8-404f-805f-ed52cdef658a,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:38.148957 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-d62ae09a-03cd-4447-989e-b9e7ee426602 req-fe05072f-6665-4a89-b904-91fc185c1654 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0842836
Jun 01 06:12:38.150199 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-03a2dc0b-3b98-48ad-9e4e-70b0609b1de0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:38.162136 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-03a2dc0b-3b98-48ad-9e4e-70b0609b1de0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:38.164099 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-03a2dc0b-3b98-48ad-9e4e-70b0609b1de0 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/634dfdf2-42a8-404f-805f-ed52cdef658a HTTP/1.1" status: 204  len: 168 time: 0.6155233
Jun 01 06:12:38.197663 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31a51861-8947-4b59-a86b-b06d9eeaba8e req-c4517647-94ad-49e0-a2e8-9adf49a94d75 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:38.200177 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-31a51861-8947-4b59-a86b-b06d9eeaba8e req-c4517647-94ad-49e0-a2e8-9adf49a94d75 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=66ffd6b4-021c-479c-bc48-aa35c8846786 HTTP/1.1" status: 200  len: 943 time: 0.6159527
Jun 01 06:12:38.245526 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-864e2c5b-05ca-4c11-b0ae-408bfeb39c46 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:38.248100 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e28ff956-2b0e-47d8-ad31-6fc8b6654ca5 req-48e62f64-a747-4b59-a1c6-b804d1e0b6f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:38.249519 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e28ff956-2b0e-47d8-ad31-6fc8b6654ca5 req-48e62f64-a747-4b59-a1c6-b804d1e0b6f2 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=6137ee10-ce13-45c9-8edb-31811502bfd7 HTTP/1.1" status: 200  len: 855 time: 0.1862657
Jun 01 06:12:38.337341 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b47ee11a-d063-4c5e-83a4-01470a82cbfb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:38.368171 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-d62ae09a-03cd-4447-989e-b9e7ee426602 req-b8167bd9-1144-406d-ae46-5a2acfe342f0 service neutron] 10.222.0.48 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1852157
Jun 01 06:12:38.387291 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-864e2c5b-05ca-4c11-b0ae-408bfeb39c46 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:38.398959 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-d053a7ae-978e-4d6f-b5c1-12ceed0d9a05 None None] Set router b7bdc21e-592c-4bbf-87c9-5eba5676579e gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:12:38.441632 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-31a51861-8947-4b59-a86b-b06d9eeaba8e req-098e5502-f592-4a11-a8cf-36f22e26a074 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2032449
Jun 01 06:12:38.534162 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-d62ae09a-03cd-4447-989e-b9e7ee426602 req-20aba512-9609-4fc4-9e57-379659345d14 service neutron] 10.222.0.48 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1586294
Jun 01 06:12:38.659314 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-f393c50e-158f-4b04-b5bd-ac20af5bd1b2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:38.686161 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cec4937-84e8-4bcd-bd92-b25c4705576a req-1682a661-924c-4069-acdc-4fa619b54585 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:38.690060 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4cec4937-84e8-4bcd-bd92-b25c4705576a req-1682a661-924c-4069-acdc-4fa619b54585 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.5093403
Jun 01 06:12:38.702741 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-f393c50e-158f-4b04-b5bd-ac20af5bd1b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:38.723398 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-a171b58b-3165-42dc-8e3c-5dba6edeb6f0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:38.778078 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e28ff956-2b0e-47d8-ad31-6fc8b6654ca5 req-84811d44-6f77-4c60-9403-24d3853669e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:38.786365 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e28ff956-2b0e-47d8-ad31-6fc8b6654ca5 req-84811d44-6f77-4c60-9403-24d3853669e4 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=5f973ed4-521b-4b78-9a54-1336b1302fa2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.5220013
Jun 01 06:12:38.880091 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-864e2c5b-05ca-4c11-b0ae-408bfeb39c46 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:38.918116 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-f393c50e-158f-4b04-b5bd-ac20af5bd1b2 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=933fcca3132c45049e1757fdfc41e367&name=default HTTP/1.1" status: 200  len: 2979 time: 1.2485273
Jun 01 06:12:38.920857 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 33012) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:38.986803 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f393c50e-158f-4b04-b5bd-ac20af5bd1b2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=006d4282-78fc-4128-ac22-3ba5427872d9,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:38.996869 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-f393c50e-158f-4b04-b5bd-ac20af5bd1b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.274s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:38.997496 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-614f48a8-bfa3-4a18-b72a-506f62d963ff admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.102s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:39.021243 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4cec4937-84e8-4bcd-bd92-b25c4705576a req-94a47cf4-868c-4f70-b463-e6b81d0420d9 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3154001
Jun 01 06:12:39.027236 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-d053a7ae-978e-4d6f-b5c1-12ceed0d9a05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b27e33a0>, [{'id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'name': 'tempest-AttachVolumeShelveTestJSON-921884409-router', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20'}], 'enable_snat': True}, 'gw_port_id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:24Z', 'updated_at': '2021-06-01T06:11:44Z', 'revision_number': 4, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'gw_port': {'id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:b4:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:27Z', 'updated_at': '2021-06-01T06:11:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '8639dc42-b15e-4dfb-b648-ca0a9c38fd05', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'floating_ip_address': '172.27.2.242', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'port_id': '826848c6-a93a-4712-82dd-39e403bcb79e', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 127, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'mac_address': 'fa:16:3e:c4:14:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1385f5c8-2a7a-45b1-a982-6f897700aa17', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:11:54Z', 'updated_at': '2021-06-01T06:12:35Z', 'revision_number': 1, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '47f62b29-867e-4af1-9330-02c97cb95473', 'name': '', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'mac_address': 'fa:16:3e:8c:f8:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:39Z', 'updated_at': '2021-06-01T06:11:57Z', 'revision_number': 5, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'subnets': [{'id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:12:39.033804 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-01e6a39e-95a6-4cd8-a042-c8605454a2af admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:39.049696 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d053a7ae-978e-4d6f-b5c1-12ceed0d9a05 None None] The sync data for ids ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'] in dv-cinder-793885-1-iscsi is: [{'id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'name': 'tempest-AttachVolumeShelveTestJSON-921884409-router', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20'}], 'enable_snat': True}, 'gw_port_id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:24Z', 'updated_at': '2021-06-01T06:11:44Z', 'revision_number': 4, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'gw_port': {'id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:b4:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:27Z', 'updated_at': '2021-06-01T06:11:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '8639dc42-b15e-4dfb-b648-ca0a9c38fd05', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'floating_ip_address': '172.27.2.242', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'port_id': '826848c6-a93a-4712-82dd-39e403bcb79e', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 127, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'mac_address': 'fa:16:3e:c4:14:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1385f5c8-2a7a-45b1-a982-6f897700aa17', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:11:54Z', 'updated_at': '2021-06-01T06:12:35Z', 'revision_number': 1, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '47f62b29-867e-4af1-9330-02c97cb95473', 'name': '', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'mac_address': 'fa:16:3e:8c:f8:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:39Z', 'updated_at': '2021-06-01T06:11:57Z', 'revision_number': 5, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'subnets': [{'id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:12:39.053660 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-864e2c5b-05ca-4c11-b0ae-408bfeb39c46 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d0d33043-addb-4737-a310-3d8ca96c9ff6,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:39.060588 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-864e2c5b-05ca-4c11-b0ae-408bfeb39c46 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:39.087687 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-864e2c5b-05ca-4c11-b0ae-408bfeb39c46 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:39.090568 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-864e2c5b-05ca-4c11-b0ae-408bfeb39c46 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/d0d33043-addb-4737-a310-3d8ca96c9ff6 HTTP/1.1" status: 204  len: 168 time: 1.3131573
Jun 01 06:12:39.094261 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-01e6a39e-95a6-4cd8-a042-c8605454a2af admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:39.123641 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e28ff956-2b0e-47d8-ad31-6fc8b6654ca5 req-ce9a9198-6097-4bc1-ab51-c6873684aa57 service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2838454
Jun 01 06:12:39.177456 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-01e6a39e-95a6-4cd8-a042-c8605454a2af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:39.183193 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-379e0958-258b-42b6-832c-138aeae1028e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:39.205564 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01e6a39e-95a6-4cd8-a042-c8605454a2af admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=006d4282-78fc-4128-ac22-3ba5427872d9,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:39.210341 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-01e6a39e-95a6-4cd8-a042-c8605454a2af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:39.212629 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-01e6a39e-95a6-4cd8-a042-c8605454a2af admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:39.216425 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-01e6a39e-95a6-4cd8-a042-c8605454a2af admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/006d4282-78fc-4128-ac22-3ba5427872d9 HTTP/1.1" status: 204  len: 168 time: 0.2922766
Jun 01 06:12:39.304384 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e28ff956-2b0e-47d8-ad31-6fc8b6654ca5 req-08b045da-d496-426b-a557-d6b8691f248b service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1695585
Jun 01 06:12:39.360386 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d13bebbd-636d-45f7-bcdd-05ff368b2d24 None None] New status for floating IP 8639dc42-b15e-4dfb-b648-ca0a9c38fd05: ACTIVE {{(pid=92231) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 06:12:39.657746 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b2294b4-5789-490f-9376-35a50ddbf10f req-17d07fef-8ce2-4351-a01b-5bcf325a98f8 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:39.665275 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8b2294b4-5789-490f-9376-35a50ddbf10f req-17d07fef-8ce2-4351-a01b-5bcf325a98f8 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=66ffd6b4-021c-479c-bc48-aa35c8846786 HTTP/1.1" status: 200  len: 943 time: 0.1103485
Jun 01 06:12:39.811960 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8b2294b4-5789-490f-9376-35a50ddbf10f req-2593fb41-7c43-410b-9325-a28a503b6b16 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1451104
Jun 01 06:12:39.872138 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5521ae0f-c389-48ad-bc47-29ab7421f232 req-a835cc46-b4da-48f9-9cce-8d89e5e9f73d service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1367581
Jun 01 06:12:40.061553 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5521ae0f-c389-48ad-bc47-29ab7421f232 req-4c0e0052-8ad2-4c2c-81f2-592ff4933d0c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:40.063259 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5521ae0f-c389-48ad-bc47-29ab7421f232 req-4c0e0052-8ad2-4c2c-81f2-592ff4933d0c service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=b02068c8f29e4f5e9b3c965d023f7e29&device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 1098 time: 0.0999305
Jun 01 06:12:40.295734 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5521ae0f-c389-48ad-bc47-29ab7421f232 req-bf0f9f62-c378-430b-9b36-042dcd7c74b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:40.297218 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5521ae0f-c389-48ad-bc47-29ab7421f232 req-bf0f9f62-c378-430b-9b36-042dcd7c74b1 service neutron] 10.222.0.48 "GET /v2.0/networks?id=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 HTTP/1.1" status: 200  len: 915 time: 0.2006254
Jun 01 06:12:40.313366 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e97289ed-3669-4dd2-8775-509394477f67 req-d8117c39-91c6-47aa-b39f-7f1da2617e41 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:40.314857 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e97289ed-3669-4dd2-8775-509394477f67 req-d8117c39-91c6-47aa-b39f-7f1da2617e41 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.1353540
Jun 01 06:12:40.393721 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5521ae0f-c389-48ad-bc47-29ab7421f232 req-5fb2b903-1c5a-437d-bd27-dc706df47fd1 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=de8f02a4-b74f-47df-a797-bc3cbe7be366 HTTP/1.1" status: 200  len: 217 time: 0.0779068
Jun 01 06:12:40.459650 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e97289ed-3669-4dd2-8775-509394477f67 req-4582c500-4e14-4034-b2bc-967257b1fa6f tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0955825
Jun 01 06:12:40.486224 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5521ae0f-c389-48ad-bc47-29ab7421f232 req-83b72df1-0b8d-4fea-a6a2-647ddb89d1ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:40.486224 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5521ae0f-c389-48ad-bc47-29ab7421f232 req-83b72df1-0b8d-4fea-a6a2-647ddb89d1ed service neutron] 10.222.0.48 "GET /v2.0/subnets?id=52a5c0c8-e902-4e55-bfa8-495f043331da HTTP/1.1" status: 200  len: 854 time: 0.0739994
Jun 01 06:12:40.539940 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5521ae0f-c389-48ad-bc47-29ab7421f232 req-7089758a-d1fa-49f9-94b5-bbbd991be939 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0469093
Jun 01 06:12:40.599306 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device b83de976-8a2a-4caf-b3a4-4f2d2016ddd4 details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:12:40.768597 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5521ae0f-c389-48ad-bc47-29ab7421f232 req-09248397-880a-4ab9-b934-88a9bca439bf service neutron] 10.222.0.48 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2218385
Jun 01 06:12:40.803229 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port b83de976-8a2a-4caf-b3a4-4f2d2016ddd4, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=b83de976-8a2a-4caf-b3a4-4f2d2016ddd4,segment=NetworkSegment(7e12089c-d8cc-429c-8b7b-f5d148a55957),segment_id=7e12089c-d8cc-429c-8b7b-f5d148a55957)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:12:40.824455 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': 'b83de976-8a2a-4caf-b3a4-4f2d2016ddd4', 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6', 'port_id': 'b83de976-8a2a-4caf-b3a4-4f2d2016ddd4', 'mac_address': 'fa:16:3e:be:df:09', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 206, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '52a5c0c8-e902-4e55-bfa8-495f043331da', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:12:40.897997 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:40.967684 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b83de976-8a2a-4caf-b3a4-4f2d2016ddd4 {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:12:40.990212 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port b83de976-8a2a-4caf-b3a4-4f2d2016ddd4, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=b83de976-8a2a-4caf-b3a4-4f2d2016ddd4,segment=NetworkSegment(7e12089c-d8cc-429c-8b7b-f5d148a55957),segment_id=7e12089c-d8cc-429c-8b7b-f5d148a55957)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:12:40.996824 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:40.999939 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-a2ed443d-1b37-414a-a88c-45dc9dbafab9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:41.121653 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=b83de976-8a2a-4caf-b3a4-4f2d2016ddd4,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:41.127215 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:41.204209 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5521ae0f-c389-48ad-bc47-29ab7421f232 req-ccd37d94-3f8d-4e6e-85fd-3d7920f06159 service neutron] 10.222.0.48 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4278927
Jun 01 06:12:41.236011 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:41.298591 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['b83de976-8a2a-4caf-b3a4-4f2d2016ddd4'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:12:41.476813 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab8b8a3a-de76-4c0e-86af-b614ddda2eb5 req-71ec19a1-57cf-4bb9-bc23-8c696e7c1a1d tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:41.484736 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ab8b8a3a-de76-4c0e-86af-b614ddda2eb5 req-71ec19a1-57cf-4bb9-bc23-8c696e7c1a1d tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=66ffd6b4-021c-479c-bc48-aa35c8846786 HTTP/1.1" status: 200  len: 944 time: 0.1294174
Jun 01 06:12:41.541134 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ab8b8a3a-de76-4c0e-86af-b614ddda2eb5 req-66067bc0-f2e4-4479-86e2-cfc3298ec6d4 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0553365
Jun 01 06:12:41.812933 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf0846c3-436c-4c31-bcea-37eb18982f35 req-ef15a62d-137f-4a7e-bb37-e303b3596dca tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:41.815588 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bf0846c3-436c-4c31-bcea-37eb18982f35 req-ef15a62d-137f-4a7e-bb37-e303b3596dca tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.1533012
Jun 01 06:12:41.893621 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bf0846c3-436c-4c31-bcea-37eb18982f35 req-f41f01b7-125d-4d5d-977e-094a89059376 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0719659
Jun 01 06:12:42.343555 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-5068f5d4-8365-4938-ae86-122261a43f72 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:42.618198 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device b83de976-8a2a-4caf-b3a4-4f2d2016ddd4 up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:12:42.692138 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning for port b83de976-8a2a-4caf-b3a4-4f2d2016ddd4 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:12:42.700068 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port b83de976-8a2a-4caf-b3a4-4f2d2016ddd4 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:12:42.701082 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:42.751171 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd2e19b6-6d91-402f-8720-332e06dea911 req-9e2545d6-6d66-44c0-a35a-8db2cff2f384 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:42.752705 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fd2e19b6-6d91-402f-8720-332e06dea911 req-9e2545d6-6d66-44c0-a35a-8db2cff2f384 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=66ffd6b4-021c-479c-bc48-aa35c8846786 HTTP/1.1" status: 200  len: 944 time: 0.0947368
Jun 01 06:12:42.804492 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fd2e19b6-6d91-402f-8720-332e06dea911 req-bf9bb8bb-5bfa-42cf-8ac3-3ffbae41e54c tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0454469
Jun 01 06:12:42.853493 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:42.910192 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '66ffd6b4-021c-479c-bc48-aa35c8846786', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b83de976-8a2a-4caf-b3a4-4f2d2016ddd4'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:12:42.913218 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-72d7ed03-e38c-4567-b0fc-922ea1c398e8" -d '{"events": [{"server_uuid": "66ffd6b4-021c-479c-bc48-aa35c8846786", "name": "network-vif-plugged", "status": "completed", "tag": "b83de976-8a2a-4caf-b3a4-4f2d2016ddd4"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:12:42.925351 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port b83de976-8a2a-4caf-b3a4-4f2d2016ddd4, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=b83de976-8a2a-4caf-b3a4-4f2d2016ddd4,segment=NetworkSegment(7e12089c-d8cc-429c-8b7b-f5d148a55957),segment_id=7e12089c-d8cc-429c-8b7b-f5d148a55957)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:12:42.953480 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:42.956203 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-bb5444a0-5b14-4a1d-95d6-ab442a6eedee None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:43.070273 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:12:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-03606fe1-5894-441a-a44c-5aea892a3287 x-openstack-request-id: req-03606fe1-5894-441a-a44c-5aea892a3287 {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:12:43.071524 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "66ffd6b4-021c-479c-bc48-aa35c8846786", "name": "network-vif-plugged", "status": "completed", "tag": "b83de976-8a2a-4caf-b3a4-4f2d2016ddd4", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:12:43.071524 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-03606fe1-5894-441a-a44c-5aea892a3287 {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:12:43.071524 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '66ffd6b4-021c-479c-bc48-aa35c8846786', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b83de976-8a2a-4caf-b3a4-4f2d2016ddd4', 'code': 200}
Jun 01 06:12:43.109050 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=b83de976-8a2a-4caf-b3a4-4f2d2016ddd4,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:43.114838 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:43.200093 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd3e8cdd-edbc-4ad9-90c7-a787639e63b2 req-f637478e-a910-485d-902c-af3f8ef93cf6 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:43.207296 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fd3e8cdd-edbc-4ad9-90c7-a787639e63b2 req-f637478e-a910-485d-902c-af3f8ef93cf6 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.1186540
Jun 01 06:12:43.264748 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:43.267467 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fd3e8cdd-edbc-4ad9-90c7-a787639e63b2 req-51eb4754-3349-455e-a3ed-7b70ba92c8cc tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0593278
Jun 01 06:12:43.420708 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82914aba-bec3-44f3-a9e8-1dbc95b33eed req-37d8933c-7a92-43f1-ac3c-f49416c94d31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:43.422368 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-82914aba-bec3-44f3-a9e8-1dbc95b33eed req-37d8933c-7a92-43f1-ac3c-f49416c94d31 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=66ffd6b4-021c-479c-bc48-aa35c8846786 HTTP/1.1" status: 200  len: 1098 time: 0.0872600
Jun 01 06:12:43.474694 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-82914aba-bec3-44f3-a9e8-1dbc95b33eed req-b725454c-81db-47d2-b6b2-36634e8b7ce9 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0435467
Jun 01 06:12:43.616972 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 33206) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:43.717244 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:12:43.742794 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-fe6e2b83-f91b-418e-a105-43834a6bd355 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:43.758998 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-fe6e2b83-f91b-418e-a105-43834a6bd355 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:43.763091 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-fe6e2b83-f91b-418e-a105-43834a6bd355 admin admin] Usage tracker for resource:security_group_rule and tenant:3087387454eb4beebf56585de29a7e8d is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:43.766014 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-fe6e2b83-f91b-418e-a105-43834a6bd355 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:43.771767 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-fe6e2b83-f91b-418e-a105-43834a6bd355 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:43.881521 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-fe6e2b83-f91b-418e-a105-43834a6bd355 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:43.890757 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-fe6e2b83-f91b-418e-a105-43834a6bd355 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:43.901801 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-39390b8b-857f-40a1-b112-95d1f076fad0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:43.973986 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-fe6e2b83-f91b-418e-a105-43834a6bd355 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=3087387454eb4beebf56585de29a7e8d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3555620
Jun 01 06:12:43.976081 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe6e2b83-f91b-418e-a105-43834a6bd355 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4e38dab0-62de-456b-a3a7-d4be81294a03,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:43.977569 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 33216) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:43.985601 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-fe6e2b83-f91b-418e-a105-43834a6bd355 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:44.081298 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-a9e7ec46-6ee2-43dc-9501-8723db0170b0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:44.094216 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f693f5d9-e22e-4c17-9c2b-6e63e54c50b6 req-5005a6ab-e215-459d-82de-6cfb05eaebac tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:44.095745 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f693f5d9-e22e-4c17-9c2b-6e63e54c50b6 req-5005a6ab-e215-459d-82de-6cfb05eaebac tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=66ffd6b4-021c-479c-bc48-aa35c8846786 HTTP/1.1" status: 200  len: 945 time: 0.1671753
Jun 01 06:12:44.151051 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-a9e7ec46-6ee2-43dc-9501-8723db0170b0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:44.200706 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f693f5d9-e22e-4c17-9c2b-6e63e54c50b6 req-d26731e9-c576-4f19-8ecf-2e7e29947d18 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0920734
Jun 01 06:12:44.251251 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-a9e7ec46-6ee2-43dc-9501-8723db0170b0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:44.257521 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-710b02cf-780a-451e-856c-15d906098f79 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:44.274217 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9e7ec46-6ee2-43dc-9501-8723db0170b0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4e38dab0-62de-456b-a3a7-d4be81294a03,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:44.277876 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-a9e7ec46-6ee2-43dc-9501-8723db0170b0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:44.280133 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-a9e7ec46-6ee2-43dc-9501-8723db0170b0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:44.280877 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-a9e7ec46-6ee2-43dc-9501-8723db0170b0 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/4e38dab0-62de-456b-a3a7-d4be81294a03 HTTP/1.1" status: 204  len: 168 time: 0.3020833
Jun 01 06:12:44.487578 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88f35ac2-4861-4db6-b58d-6db1b0dcbf97 req-376abb74-29ec-4b2e-95b7-a6cb57913993 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:44.489155 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-88f35ac2-4861-4db6-b58d-6db1b0dcbf97 req-376abb74-29ec-4b2e-95b7-a6cb57913993 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.0874031
Jun 01 06:12:44.542880 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-88f35ac2-4861-4db6-b58d-6db1b0dcbf97 req-1357c68d-4a37-4108-a113-185197d89809 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0445867
Jun 01 06:12:44.644505 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 33232) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:44.663501 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3922dfbd-96e5-428e-9012-da64a5c61554 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:44.683836 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-3922dfbd-96e5-428e-9012-da64a5c61554 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:44.688556 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-3922dfbd-96e5-428e-9012-da64a5c61554 admin admin] Usage tracker for resource:security_group_rule and tenant:4083a2494441480db7f4af9e2e2b98b1 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:44.691926 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-3922dfbd-96e5-428e-9012-da64a5c61554 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:44.700010 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-3922dfbd-96e5-428e-9012-da64a5c61554 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:44.797551 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3922dfbd-96e5-428e-9012-da64a5c61554 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:44.801987 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3922dfbd-96e5-428e-9012-da64a5c61554 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:44.811911 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:44.853451 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3922dfbd-96e5-428e-9012-da64a5c61554 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=afbbb490-f1a4-49e4-8993-33171bb85df3,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:44.857668 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-3922dfbd-96e5-428e-9012-da64a5c61554 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=4083a2494441480db7f4af9e2e2b98b1&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2121584
Jun 01 06:12:44.858684 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-3922dfbd-96e5-428e-9012-da64a5c61554 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:44.861039 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 33236) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:44.924734 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7107b134-f013-45c9-a979-5e2037545b9a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:44.953304 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7107b134-f013-45c9-a979-5e2037545b9a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:45.006699 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7107b134-f013-45c9-a979-5e2037545b9a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:45.010663 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ade666c6-da86-4184-b145-53070a765925 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:45.025217 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7107b134-f013-45c9-a979-5e2037545b9a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=afbbb490-f1a4-49e4-8993-33171bb85df3,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:45.030863 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-7107b134-f013-45c9-a979-5e2037545b9a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:45.032684 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7107b134-f013-45c9-a979-5e2037545b9a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:45.033770 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-7107b134-f013-45c9-a979-5e2037545b9a admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/afbbb490-f1a4-49e4-8993-33171bb85df3 HTTP/1.1" status: 204  len: 168 time: 0.1715133
Jun 01 06:12:45.341219 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:45.918477 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:46.933277 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a0b3d26-4bea-40be-892b-2b3a9609d745 req-d233c091-c99e-44a6-bd71-7dda320cdc9f tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:46.935164 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9a0b3d26-4bea-40be-892b-2b3a9609d745 req-d233c091-c99e-44a6-bd71-7dda320cdc9f tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=66ffd6b4-021c-479c-bc48-aa35c8846786 HTTP/1.1" status: 200  len: 945 time: 0.1152112
Jun 01 06:12:46.943941 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c042d6fb-bf25-4de1-82af-2417906aa528 req-1425a881-33fe-4bc4-958c-301424b533db tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:46.945432 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c042d6fb-bf25-4de1-82af-2417906aa528 req-1425a881-33fe-4bc4-958c-301424b533db tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.1604600
Jun 01 06:12:47.023430 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9a0b3d26-4bea-40be-892b-2b3a9609d745 req-bb746e65-918a-43d8-b97f-0cc3427494cd tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0770054
Jun 01 06:12:47.026419 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c042d6fb-bf25-4de1-82af-2417906aa528 req-c377c333-2b8d-4e36-b243-186af82933e8 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0661640
Jun 01 06:12:50.264086 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24f70c3b-29b2-4b00-8dc9-bcf1f4e7fd20 req-123510a4-a689-4f7a-b12b-7e76c12f3332 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:50.265478 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-24f70c3b-29b2-4b00-8dc9-bcf1f4e7fd20 req-123510a4-a689-4f7a-b12b-7e76c12f3332 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.1074204
Jun 01 06:12:50.276583 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43e98ecd-71d0-4afc-b8cf-761629d04694 req-0b7e16f1-05d8-4016-b562-1f99ab6a05ab tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:50.278039 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-43e98ecd-71d0-4afc-b8cf-761629d04694 req-0b7e16f1-05d8-4016-b562-1f99ab6a05ab tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=66ffd6b4-021c-479c-bc48-aa35c8846786 HTTP/1.1" status: 200  len: 945 time: 0.1556282
Jun 01 06:12:50.345279 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-24f70c3b-29b2-4b00-8dc9-bcf1f4e7fd20 req-66c9a2c5-ad1d-4c25-9242-a33e2cb05584 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0662906
Jun 01 06:12:50.352478 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-43e98ecd-71d0-4afc-b8cf-761629d04694 req-69749557-d3b5-4965-8d1b-ec2a97f93c18 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0576863
Jun 01 06:12:51.758514 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-593786a8-9467-459b-a1b7-7435796ed085 req-b5a21d45-283f-4138-aed4-6d2ca634b4a1 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:51.758514 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-593786a8-9467-459b-a1b7-7435796ed085 req-b5a21d45-283f-4138-aed4-6d2ca634b4a1 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.2947447
Jun 01 06:12:51.775228 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f43520b-e9d9-4c90-8634-8dde956b8355 req-1a974973-7910-46e2-bb2f-46a476193407 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:51.778472 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4f43520b-e9d9-4c90-8634-8dde956b8355 req-1a974973-7910-46e2-bb2f-46a476193407 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=66ffd6b4-021c-479c-bc48-aa35c8846786 HTTP/1.1" status: 200  len: 945 time: 0.2515962
Jun 01 06:12:51.909181 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-593786a8-9467-459b-a1b7-7435796ed085 req-38a8b5ef-eb48-45a2-8377-646800147148 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1292026
Jun 01 06:12:51.923009 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4f43520b-e9d9-4c90-8634-8dde956b8355 req-960dae40-5005-4184-82a9-b1a01f463262 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1186585
Jun 01 06:12:53.222295 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 33450) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:53.227492 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f60f2e48-7634-42f7-96c8-14ecacfcd098 req-025794b6-a224-4907-82a2-9a5b99688024 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:53.229284 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f60f2e48-7634-42f7-96c8-14ecacfcd098 req-025794b6-a224-4907-82a2-9a5b99688024 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.1804256
Jun 01 06:12:53.283888 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f60f2e48-7634-42f7-96c8-14ecacfcd098 req-b15f4a7f-f3ed-465e-9722-cfbe779fe42f tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0481286
Jun 01 06:12:53.399493 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-37579fb8-a593-4d6c-a635-b29743a443d3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:53.438233 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-37579fb8-a593-4d6c-a635-b29743a443d3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:53.445349 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-37579fb8-a593-4d6c-a635-b29743a443d3 admin admin] Usage tracker for resource:security_group_rule and tenant:7fa1f3afce5a4711830986d21d4e4d08 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:53.451399 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-37579fb8-a593-4d6c-a635-b29743a443d3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:53.462386 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-37579fb8-a593-4d6c-a635-b29743a443d3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:53.596650 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-37579fb8-a593-4d6c-a635-b29743a443d3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:53.601509 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-37579fb8-a593-4d6c-a635-b29743a443d3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:53.615236 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-547120ad-a5d8-492e-b8e2-1b4f0a5ad9d2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:53.665126 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37579fb8-a593-4d6c-a635-b29743a443d3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=87ba289e-7480-4da0-b0ca-2ca71de93559,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:53.673140 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 33476) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:53.673442 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-37579fb8-a593-4d6c-a635-b29743a443d3 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=7fa1f3afce5a4711830986d21d4e4d08&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4493761
Jun 01 06:12:53.674193 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-37579fb8-a593-4d6c-a635-b29743a443d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:53.747578 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b8fd9a9a-6297-4764-9801-ec795c9edb9a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:53.783419 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b8fd9a9a-6297-4764-9801-ec795c9edb9a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:53.851540 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b8fd9a9a-6297-4764-9801-ec795c9edb9a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:53.861871 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:53.879963 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8fd9a9a-6297-4764-9801-ec795c9edb9a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=87ba289e-7480-4da0-b0ca-2ca71de93559,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:53.885788 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b8fd9a9a-6297-4764-9801-ec795c9edb9a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:53.893041 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b8fd9a9a-6297-4764-9801-ec795c9edb9a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:53.894386 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-b8fd9a9a-6297-4764-9801-ec795c9edb9a admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/87ba289e-7480-4da0-b0ca-2ca71de93559 HTTP/1.1" status: 204  len: 168 time: 0.2202168
Jun 01 06:12:54.139739 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 33496) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:54.364386 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b5234d8a-aef5-4197-81ff-f4eac977b53e admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:54.392356 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-b5234d8a-aef5-4197-81ff-f4eac977b53e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:54.406079 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-b5234d8a-aef5-4197-81ff-f4eac977b53e admin admin] Usage tracker for resource:security_group_rule and tenant:d2aad0f6e5b44b5a893212b675d5dfc5 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:54.411034 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-b5234d8a-aef5-4197-81ff-f4eac977b53e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:54.422671 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-b5234d8a-aef5-4197-81ff-f4eac977b53e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:54.553267 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b5234d8a-aef5-4197-81ff-f4eac977b53e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:54.562862 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b5234d8a-aef5-4197-81ff-f4eac977b53e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:54.571839 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-01e6a39e-95a6-4cd8-a042-c8605454a2af admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:54.616922 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-b5234d8a-aef5-4197-81ff-f4eac977b53e admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=d2aad0f6e5b44b5a893212b675d5dfc5&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4752457
Jun 01 06:12:54.618185 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5234d8a-aef5-4197-81ff-f4eac977b53e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eb07d606-3461-48cc-890e-158d7a4308b9,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:54.620924 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 33522) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:54.624175 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-b5234d8a-aef5-4197-81ff-f4eac977b53e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:54.685206 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f816e16c-89fa-49ad-9ad9-b8663ab53344 req-a93d72e1-bdac-454d-841c-85b9a71d3618 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:54.687641 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f816e16c-89fa-49ad-9ad9-b8663ab53344 req-a93d72e1-bdac-454d-841c-85b9a71d3618 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.2147770
Jun 01 06:12:54.691165 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f72bae27-034c-4d20-b069-d2f9c1a83631 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:54.725992 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f72bae27-034c-4d20-b069-d2f9c1a83631 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:54.738843 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-3873717f-159c-439a-945d-84ece1090038 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:54.740577 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-3873717f-159c-439a-945d-84ece1090038 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/networks?id=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 HTTP/1.1" status: 200  len: 814 time: 0.2286465
Jun 01 06:12:54.774398 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f816e16c-89fa-49ad-9ad9-b8663ab53344 req-0c577779-25d1-4721-9185-a555072dcf61 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0646887
Jun 01 06:12:54.776371 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-441638f9-3e26-4996-832c-514b7cee63eb tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/quotas/b02068c8f29e4f5e9b3c965d023f7e29 HTTP/1.1" status: 200  len: 375 time: 0.0230637
Jun 01 06:12:54.801314 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f72bae27-034c-4d20-b069-d2f9c1a83631 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:54.818588 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-020d37d5-ab99-46ad-805b-8fe3a5c81db7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:54.856928 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f72bae27-034c-4d20-b069-d2f9c1a83631 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eb07d606-3461-48cc-890e-158d7a4308b9,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:54.862880 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-f72bae27-034c-4d20-b069-d2f9c1a83631 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:54.880077 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f72bae27-034c-4d20-b069-d2f9c1a83631 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:54.881595 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-f72bae27-034c-4d20-b069-d2f9c1a83631 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/eb07d606-3461-48cc-890e-158d7a4308b9 HTTP/1.1" status: 204  len: 168 time: 0.2594886
Jun 01 06:12:54.955958 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-df51f1ec-aa5d-43fe-8472-ec68408f278a tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=b02068c8f29e4f5e9b3c965d023f7e29&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1729796
Jun 01 06:12:55.123140 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-8db6b89d-3442-4e5c-976a-d693c3b37d55 service neutron] 10.222.0.25 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1662905
Jun 01 06:12:55.296577 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-74cbe2ca-23d4-43bd-a4b1-8c8462378c3a service neutron] 10.222.0.25 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1665816
Jun 01 06:12:55.370474 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 33546) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:55.391459 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ce49775b-2141-443a-9c30-f2d851ee5f1f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:55.410382 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-ce49775b-2141-443a-9c30-f2d851ee5f1f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:55.414411 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-ce49775b-2141-443a-9c30-f2d851ee5f1f admin admin] Usage tracker for resource:security_group_rule and tenant:a533131d96ab4ac6a2a4281700882c41 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:12:55.418231 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-ce49775b-2141-443a-9c30-f2d851ee5f1f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:12:55.425497 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-ce49775b-2141-443a-9c30-f2d851ee5f1f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:55.524125 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8a3afe12-08d0-4d91-8eb8-cb24bdad2733 req-ab092e10-6a11-4870-ada7-8dd140d5be65 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=601c5188-c17f-47a6-83cf-a69b68517e08 HTTP/1.1" status: 200  len: 210 time: 0.0532079
Jun 01 06:12:55.585269 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ce49775b-2141-443a-9c30-f2d851ee5f1f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:55.590824 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ce49775b-2141-443a-9c30-f2d851ee5f1f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:55.598655 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-6287e5a7-7c55-4364-b845-dcff9f12c673 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:55.643236 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce49775b-2141-443a-9c30-f2d851ee5f1f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2394a0ab-ab87-41f9-a8ee-e099671eef63,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:55.647171 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ce49775b-2141-443a-9c30-f2d851ee5f1f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:55.649754 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-ce49775b-2141-443a-9c30-f2d851ee5f1f admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=a533131d96ab4ac6a2a4281700882c41&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2780766
Jun 01 06:12:55.652610 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 33560) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:12:55.751987 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-af912143-81e6-4264-8d0d-28a68ef9f762 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:55.781454 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-af912143-81e6-4264-8d0d-28a68ef9f762 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:55.839964 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-af912143-81e6-4264-8d0d-28a68ef9f762 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:55.845291 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:55.859509 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af912143-81e6-4264-8d0d-28a68ef9f762 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2394a0ab-ab87-41f9-a8ee-e099671eef63,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:55.862556 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-af912143-81e6-4264-8d0d-28a68ef9f762 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:55.863349 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-af912143-81e6-4264-8d0d-28a68ef9f762 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:55.864952 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-af912143-81e6-4264-8d0d-28a68ef9f762 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/2394a0ab-ab87-41f9-a8ee-e099671eef63 HTTP/1.1" status: 204  len: 168 time: 0.2113543
Jun 01 06:12:56.050993 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93df01c4-1953-4eb7-ab09-6c69641631d5 req-7981a2f2-2eb5-4ed3-a7fb-eb8190e8eadf tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:56.053867 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-93df01c4-1953-4eb7-ab09-6c69641631d5 req-7981a2f2-2eb5-4ed3-a7fb-eb8190e8eadf tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.1127172
Jun 01 06:12:56.133905 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-93df01c4-1953-4eb7-ab09-6c69641631d5 req-7266634e-10e1-4603-b4d2-b92007130435 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0715644
Jun 01 06:12:56.742402 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-39b15696-dc3b-4d1a-8625-b73ed3ecde61 req-bb337526-4593-4afd-82c0-cfa0c6d5d269 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=601c5188-c17f-47a6-83cf-a69b68517e08 HTTP/1.1" status: 200  len: 210 time: 0.0624053
Jun 01 06:12:56.988912 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-d4da68e6-99c3-45f5-b815-4f9d8d743349 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:56.990428 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-d4da68e6-99c3-45f5-b815-4f9d8d743349 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.48 "GET /v2.0/networks?id=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 HTTP/1.1" status: 200  len: 814 time: 0.2136772
Jun 01 06:12:57.006846 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-f6c5d64e-a1ae-4c10-bd84-ad0680628fcd tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Request body: {'port': {'device_id': '601c5188-c17f-47a6-83cf-a69b68517e08', 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6', 'admin_state_up': True, 'tenant_id': 'b02068c8f29e4f5e9b3c965d023f7e29'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:12:57.220703 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-f6c5d64e-a1ae-4c10-bd84-ad0680628fcd tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:12:57.232400 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-f6c5d64e-a1ae-4c10-bd84-ad0680628fcd tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:12:57.254079 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-f6c5d64e-a1ae-4c10-bd84-ad0680628fcd tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Made reservation on behalf of b02068c8f29e4f5e9b3c965d023f7e29 for: {'port': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:12:57.259160 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-f6c5d64e-a1ae-4c10-bd84-ad0680628fcd tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:57.592815 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b673fa4e-eaba-40bd-a5bc-3686d7c23e9e req-95fa6d5b-9946-4ee3-920d-a9a7079aa4e2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:57.594343 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b673fa4e-eaba-40bd-a5bc-3686d7c23e9e req-95fa6d5b-9946-4ee3-920d-a9a7079aa4e2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.2657275
Jun 01 06:12:57.613130 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-f6c5d64e-a1ae-4c10-bd84-ad0680628fcd tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Allocated IP 172.20.0.9 (8c37e9ed-7031-4d7f-bfd1-3763eabba1b6/52a5c0c8-e902-4e55-bfa8-495f043331da/690a6f90-fdb6-46f4-8f05-03e0ab827f78) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:12:57.687026 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b673fa4e-eaba-40bd-a5bc-3686d7c23e9e req-d78f9ecb-4a73-45a1-9440-4b52d073a96b tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0809124
Jun 01 06:12:57.936876 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3065f275-eb55-43ea-abfd-84b20901c255 req-a07cc447-234e-4252-89c5-f55a81e08356 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=601c5188-c17f-47a6-83cf-a69b68517e08 HTTP/1.1" status: 200  len: 210 time: 0.0586224
Jun 01 06:12:57.946257 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-f6c5d64e-a1ae-4c10-bd84-ad0680628fcd tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:57.983320 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-f6c5d64e-a1ae-4c10-bd84-ad0680628fcd tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:57.988980 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:58.002428 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['de8f02a4-b74f-47df-a797-bc3cbe7be366', 'b83de976-8a2a-4caf-b3a4-4f2d2016ddd4'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:12:58.066495 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-f6c5d64e-a1ae-4c10-bd84-ad0680628fcd tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Network 8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:12:58.069866 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-f6c5d64e-a1ae-4c10-bd84-ad0680628fcd tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:12:58.075341 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-f6c5d64e-a1ae-4c10-bd84-ad0680628fcd tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:12:58.081111 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-f6c5d64e-a1ae-4c10-bd84-ad0680628fcd tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:58.081760 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-f6c5d64e-a1ae-4c10-bd84-ad0680628fcd tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:58.097000 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6c5d64e-a1ae-4c10-bd84-ad0680628fcd tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Pushing event updated for resources: {'Port': ['ID=690a6f90-fdb6-46f4-8f05-03e0ab827f78,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:58.102021 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-f6c5d64e-a1ae-4c10-bd84-ad0680628fcd tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:58.118413 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-f6c5d64e-a1ae-4c10-bd84-ad0680628fcd tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.1158547
Jun 01 06:12:58.138462 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Request body: {'port': {'device_id': '601c5188-c17f-47a6-83cf-a69b68517e08', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79388'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:12:58.283359 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:58.919681 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 690a6f90-fdb6-46f4-8f05-03e0ab827f78 {{(pid=92229) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:12:58.929542 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:58.956727 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Transition to ACTIVE for port object 690a6f90-fdb6-46f4-8f05-03e0ab827f78 will not be triggered until provisioned by entity L2. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:12:58.961755 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:58.967463 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:59.185124 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e4ae302-4b17-4466-b58d-e1e2b7dc4ad0 req-78f51d5a-35e9-4a68-9db5-c95d9368e4e7 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:59.186557 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0e4ae302-4b17-4466-b58d-e1e2b7dc4ad0 req-78f51d5a-35e9-4a68-9db5-c95d9368e4e7 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.3179224
Jun 01 06:12:59.192539 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Pushing event updated for resources: {'Port': ['ID=690a6f90-fdb6-46f4-8f05-03e0ab827f78,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:59.205638 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.238s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:59.250111 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Attempting to bind port 690a6f90-fdb6-46f4-8f05-03e0ab827f78 on host hv-cinder-79388 for vnic_type normal with profile  {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:12:59.250433 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Attempting to bind port 690a6f90-fdb6-46f4-8f05-03e0ab827f78 by drivers openvswitch,hyperv on host hv-cinder-79388 at level 0 using segments [{'id': '7e12089c-d8cc-429c-8b7b-f5d148a55957', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 206, 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6'}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:12:59.250750 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Attempting to bind port 690a6f90-fdb6-46f4-8f05-03e0ab827f78 on network 8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:12:59.265635 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Port 690a6f90-fdb6-46f4-8f05-03e0ab827f78 on network 8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79388 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 06:12:59.265949 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Attempting to bind port 690a6f90-fdb6-46f4-8f05-03e0ab827f78 on network 8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:12:59.272686 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0e4ae302-4b17-4466-b58d-e1e2b7dc4ad0 req-698992c3-153d-474a-a1ca-28fc6d1913fb tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0775266
Jun 01 06:12:59.278755 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Checking agent: {'id': '56148394-2131-4d06-bcfa-c032301591b8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79388', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'started_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 12, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:12:59.279083 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Checking segment: {'id': '7e12089c-d8cc-429c-8b7b-f5d148a55957', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 206, 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:12:59.279456 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Bound using segment: {'id': '7e12089c-d8cc-429c-8b7b-f5d148a55957', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 206, 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6'} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:12:59.279905 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Bound port: 690a6f90-fdb6-46f4-8f05-03e0ab827f78, host: hv-cinder-79388, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7e12089c-d8cc-429c-8b7b-f5d148a55957', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 206, 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6'}}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:12:59.280242 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:59.341893 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-617909f1-8bb3-4fe4-a29e-d8a2d703d75a req-8598903e-c16d-4526-883c-d0ce6d0859b6 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:59.342642 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-617909f1-8bb3-4fe4-a29e-d8a2d703d75a req-8598903e-c16d-4526-883c-d0ce6d0859b6 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Synchronizing usage tracker for tenant:b02068c8f29e4f5e9b3c965d023f7e29 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:12:59.386861 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-617909f1-8bb3-4fe4-a29e-d8a2d703d75a req-8598903e-c16d-4526-883c-d0ce6d0859b6 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Unset dirty status for tenant:b02068c8f29e4f5e9b3c965d023f7e29 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:12:59.388026 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-617909f1-8bb3-4fe4-a29e-d8a2d703d75a req-8598903e-c16d-4526-883c-d0ce6d0859b6 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=601c5188-c17f-47a6-83cf-a69b68517e08 HTTP/1.1" status: 200  len: 943 time: 0.3166983
Jun 01 06:12:59.418259 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] For port 690a6f90-fdb6-46f4-8f05-03e0ab827f78, host hv-cinder-79388, cleared binding levels {{(pid=92229) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:12:59.436719 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] For port 690a6f90-fdb6-46f4-8f05-03e0ab827f78, host hv-cinder-79388, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=690a6f90-fdb6-46f4-8f05-03e0ab827f78,segment=NetworkSegment(7e12089c-d8cc-429c-8b7b-f5d148a55957),segment_id=7e12089c-d8cc-429c-8b7b-f5d148a55957)] {{(pid=92229) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:12:59.442019 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:59.449849 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-9a881612-5f00-497c-9efd-87541a7c2702 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:12:59.492594 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-617909f1-8bb3-4fe4-a29e-d8a2d703d75a req-42a3727c-7dc2-40a3-978a-f4747f386be5 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0965626
Jun 01 06:12:59.517879 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:59.518489 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:12:59.519872 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] 10.222.0.48 "PUT /v2.0/ports/690a6f90-fdb6-46f4-8f05-03e0ab827f78 HTTP/1.1" status: 200  len: 1093 time: 1.3868537
Jun 01 06:12:59.520359 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '601c5188-c17f-47a6-83cf-a69b68517e08', 'tag': '690a6f90-fdb6-46f4-8f05-03e0ab827f78'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:12:59.522638 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ba4f8a43-a282-4047-bb25-c1958a3e3f23" -d '{"events": [{"name": "network-changed", "server_uuid": "601c5188-c17f-47a6-83cf-a69b68517e08", "tag": "690a6f90-fdb6-46f4-8f05-03e0ab827f78"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:12:59.557840 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Pushing event updated for resources: {'Port': ['ID=690a6f90-fdb6-46f4-8f05-03e0ab827f78,revision_number=3']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:12:59.562193 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:12:59.612885 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:12:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-564c6e55-9d28-4637-ad6c-82b4c9443924 x-openstack-request-id: req-564c6e55-9d28-4637-ad6c-82b4c9443924 {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:12:59.613189 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "601c5188-c17f-47a6-83cf-a69b68517e08", "tag": "690a6f90-fdb6-46f4-8f05-03e0ab827f78", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:12:59.613461 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-564c6e55-9d28-4637-ad6c-82b4c9443924 {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:12:59.613871 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '601c5188-c17f-47a6-83cf-a69b68517e08', 'tag': '690a6f90-fdb6-46f4-8f05-03e0ab827f78', 'status': 'completed', 'code': 200}
Jun 01 06:12:59.653123 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-e1e9781d-baeb-4609-9dbf-41f7054120ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:59.654643 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-e1e9781d-baeb-4609-9dbf-41f7054120ff service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=b02068c8f29e4f5e9b3c965d023f7e29&device_id=601c5188-c17f-47a6-83cf-a69b68517e08 HTTP/1.1" status: 200  len: 1096 time: 0.0812130
Jun 01 06:12:59.813944 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-17b9542c-23ff-4abc-8843-0fb17c9a04a1 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=690a6f90-fdb6-46f4-8f05-03e0ab827f78 HTTP/1.1" status: 200  len: 217 time: 0.1482735
Jun 01 06:12:59.884169 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-295f137c-e046-40c8-87a0-8e9a11ea2b80 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:12:59.886899 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-295f137c-e046-40c8-87a0-8e9a11ea2b80 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=52a5c0c8-e902-4e55-bfa8-495f043331da HTTP/1.1" status: 200  len: 854 time: 0.0637653
Jun 01 06:12:59.942542 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-daed1e50-1417-4169-af44-3ef95fe08c39 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0464098
Jun 01 06:13:00.118397 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-43f1cf1b-7670-4de1-9c55-9c0b914fdd56 service neutron] 10.222.0.48 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1596522
Jun 01 06:13:00.345461 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c896b52d-6618-4dde-8908-22e8c5f041e1 req-1d95294a-605c-4524-96e1-02e442929bf7 service neutron] 10.222.0.48 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2130768
Jun 01 06:13:00.607850 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba4f8a43-a282-4047-bb25-c1958a3e3f23 req-32264371-664e-423a-b18a-d89a26880381 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:00.607850 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ba4f8a43-a282-4047-bb25-c1958a3e3f23 req-32264371-664e-423a-b18a-d89a26880381 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=b02068c8f29e4f5e9b3c965d023f7e29&device_id=601c5188-c17f-47a6-83cf-a69b68517e08 HTTP/1.1" status: 200  len: 1096 time: 0.1661224
Jun 01 06:13:00.689144 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcb15c49-3ab3-4edd-8598-2a5280b9c825 req-ee3f4a91-e57a-43d8-b17b-de69eef34c85 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:00.693086 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bcb15c49-3ab3-4edd-8598-2a5280b9c825 req-ee3f4a91-e57a-43d8-b17b-de69eef34c85 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.2121499
Jun 01 06:13:00.904748 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bcb15c49-3ab3-4edd-8598-2a5280b9c825 req-dddb1da2-47d7-4a6a-8901-35021ad7fb0d tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1585085
Jun 01 06:13:00.910097 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba4f8a43-a282-4047-bb25-c1958a3e3f23 req-e4561b81-a142-46e4-aa4c-25ae514f258d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:00.911614 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ba4f8a43-a282-4047-bb25-c1958a3e3f23 req-e4561b81-a142-46e4-aa4c-25ae514f258d service neutron] 10.222.0.48 "GET /v2.0/networks?id=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 HTTP/1.1" status: 200  len: 915 time: 0.2909546
Jun 01 06:13:00.999830 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ba4f8a43-a282-4047-bb25-c1958a3e3f23 req-767fafda-2402-4107-83b7-89d231acc892 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=690a6f90-fdb6-46f4-8f05-03e0ab827f78 HTTP/1.1" status: 200  len: 217 time: 0.0787246
Jun 01 06:13:01.008514 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e671812-dc25-4553-9276-7848406ab59b req-3083438d-31d8-435e-9817-3c5715da0614 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:01.010337 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3e671812-dc25-4553-9276-7848406ab59b req-3083438d-31d8-435e-9817-3c5715da0614 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=601c5188-c17f-47a6-83cf-a69b68517e08 HTTP/1.1" status: 200  len: 943 time: 0.2625647
Jun 01 06:13:01.112404 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3e671812-dc25-4553-9276-7848406ab59b req-fce93a17-d94c-4c62-ad9a-7d4c8a5bff48 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0672066
Jun 01 06:13:01.114092 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba4f8a43-a282-4047-bb25-c1958a3e3f23 req-73419177-ca28-4394-ac49-ce35b850ebcc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:01.116480 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ba4f8a43-a282-4047-bb25-c1958a3e3f23 req-73419177-ca28-4394-ac49-ce35b850ebcc service neutron] 10.222.0.48 "GET /v2.0/subnets?id=52a5c0c8-e902-4e55-bfa8-495f043331da HTTP/1.1" status: 200  len: 854 time: 0.1021562
Jun 01 06:13:01.172374 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ba4f8a43-a282-4047-bb25-c1958a3e3f23 req-38e574f5-39ba-4da5-8693-db748092aabf service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0490479
Jun 01 06:13:01.331451 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ba4f8a43-a282-4047-bb25-c1958a3e3f23 req-b5038250-a4a1-430d-b566-981a850e77e0 service neutron] 10.222.0.48 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1425049
Jun 01 06:13:01.491505 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ba4f8a43-a282-4047-bb25-c1958a3e3f23 req-210c68b7-8d16-4fa3-a696-cbbae801f14d service neutron] 10.222.0.48 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1508639
Jun 01 06:13:01.969681 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 33764) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:02.127416 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-bc98b0b6-d2bf-4e26-b740-8c58dfb076c1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:02.146121 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-bc98b0b6-d2bf-4e26-b740-8c58dfb076c1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:02.166655 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c97d14e2-2701-406e-8d99-c3c503d2d774 req-2a3cba2b-f4f5-4d31-8f0a-9b1a1a191c85 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:02.174220 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c97d14e2-2701-406e-8d99-c3c503d2d774 req-2a3cba2b-f4f5-4d31-8f0a-9b1a1a191c85 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.1496520
Jun 01 06:13:02.176765 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-bc98b0b6-d2bf-4e26-b740-8c58dfb076c1 admin admin] Usage tracker for resource:security_group_rule and tenant:92359df01493409998b0b0882b114ebf is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:02.180121 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-bc98b0b6-d2bf-4e26-b740-8c58dfb076c1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:02.190439 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-bc98b0b6-d2bf-4e26-b740-8c58dfb076c1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:02.291997 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c97d14e2-2701-406e-8d99-c3c503d2d774 req-cb9d1691-e189-4129-802e-3b5da2366730 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1159942
Jun 01 06:13:02.442131 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-bc98b0b6-d2bf-4e26-b740-8c58dfb076c1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:02.452713 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-bc98b0b6-d2bf-4e26-b740-8c58dfb076c1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:02.461496 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-af912143-81e6-4264-8d0d-28a68ef9f762 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:02.511850 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-bc98b0b6-d2bf-4e26-b740-8c58dfb076c1 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=92359df01493409998b0b0882b114ebf&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5406880
Jun 01 06:13:02.514911 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 33784) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:02.516330 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc98b0b6-d2bf-4e26-b740-8c58dfb076c1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9b7136f3-1add-42d2-87b7-db14bc9362dd,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:02.519880 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-bc98b0b6-d2bf-4e26-b740-8c58dfb076c1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:02.534376 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f494b64d-b844-45ab-b67c-58fea4d6e0b8 req-860f08da-3f2e-49bf-9ada-db3cc54ad7d7 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:02.535978 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f494b64d-b844-45ab-b67c-58fea4d6e0b8 req-860f08da-3f2e-49bf-9ada-db3cc54ad7d7 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=601c5188-c17f-47a6-83cf-a69b68517e08 HTTP/1.1" status: 200  len: 943 time: 0.1706142
Jun 01 06:13:02.585902 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2752679c-7957-4b67-bd98-b564c63c87f2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:02.596444 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f494b64d-b844-45ab-b67c-58fea4d6e0b8 req-f1b9e5d0-0610-45d4-8bae-49894da3003b tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0525811
Jun 01 06:13:02.637188 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2752679c-7957-4b67-bd98-b564c63c87f2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:02.715893 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2752679c-7957-4b67-bd98-b564c63c87f2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:02.717554 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 690a6f90-fdb6-46f4-8f05-03e0ab827f78 details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:13:02.720068 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-8f2fe24c-2269-45d7-922f-84e03d953cd6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:02.733781 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2752679c-7957-4b67-bd98-b564c63c87f2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9b7136f3-1add-42d2-87b7-db14bc9362dd,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:02.737536 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-2752679c-7957-4b67-bd98-b564c63c87f2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:02.742394 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2752679c-7957-4b67-bd98-b564c63c87f2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:02.746458 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-2752679c-7957-4b67-bd98-b564c63c87f2 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/9b7136f3-1add-42d2-87b7-db14bc9362dd HTTP/1.1" status: 204  len: 168 time: 0.2278566
Jun 01 06:13:02.882314 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 690a6f90-fdb6-46f4-8f05-03e0ab827f78, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=690a6f90-fdb6-46f4-8f05-03e0ab827f78,segment=NetworkSegment(7e12089c-d8cc-429c-8b7b-f5d148a55957),segment_id=7e12089c-d8cc-429c-8b7b-f5d148a55957)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:13:02.895502 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 33798) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:02.897683 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': '690a6f90-fdb6-46f4-8f05-03e0ab827f78', 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6', 'port_id': '690a6f90-fdb6-46f4-8f05-03e0ab827f78', 'mac_address': 'fa:16:3e:67:3a:76', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 206, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '52a5c0c8-e902-4e55-bfa8-495f043331da', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:13:02.974391 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:03.003604 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 690a6f90-fdb6-46f4-8f05-03e0ab827f78 {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:13:03.026865 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 690a6f90-fdb6-46f4-8f05-03e0ab827f78, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=690a6f90-fdb6-46f4-8f05-03e0ab827f78,segment=NetworkSegment(7e12089c-d8cc-429c-8b7b-f5d148a55957),segment_id=7e12089c-d8cc-429c-8b7b-f5d148a55957)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:13:03.030277 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:03.033915 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:03.108520 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 33804) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:03.109679 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=690a6f90-fdb6-46f4-8f05-03e0ab827f78,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:03.113111 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:03.145832 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-38eb2264-2557-476f-b8c6-3966a2504cdf admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:03.157350 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-99337506-a8c7-483e-b674-c68923b32fcb admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:03.173600 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-38eb2264-2557-476f-b8c6-3966a2504cdf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:03.177945 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-99337506-a8c7-483e-b674-c68923b32fcb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:03.180191 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-38eb2264-2557-476f-b8c6-3966a2504cdf admin admin] Usage tracker for resource:security_group_rule and tenant:5c22b9c85b8e4940bcae36eb1847849b is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:03.184744 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-38eb2264-2557-476f-b8c6-3966a2504cdf admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:03.187495 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-99337506-a8c7-483e-b674-c68923b32fcb admin admin] Usage tracker for resource:security_group_rule and tenant:93f6d4f1b1cb4ba29da9d080cb4825b8 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:03.192381 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-99337506-a8c7-483e-b674-c68923b32fcb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:03.195003 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-38eb2264-2557-476f-b8c6-3966a2504cdf admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:03.201062 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-99337506-a8c7-483e-b674-c68923b32fcb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:03.354721 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-38eb2264-2557-476f-b8c6-3966a2504cdf admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:03.356609 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-99337506-a8c7-483e-b674-c68923b32fcb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:03.359135 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-38eb2264-2557-476f-b8c6-3966a2504cdf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:03.366059 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-0d6b4f75-2cdc-4e9a-9d8a-edec9f4c998a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:03.375692 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-99337506-a8c7-483e-b674-c68923b32fcb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:03.421553 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['690a6f90-fdb6-46f4-8f05-03e0ab827f78'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:13:03.436172 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-38eb2264-2557-476f-b8c6-3966a2504cdf admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=5c22b9c85b8e4940bcae36eb1847849b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3259554
Jun 01 06:13:03.440884 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 33814) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:03.443748 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38eb2264-2557-476f-b8c6-3966a2504cdf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=49528110-75c3-4718-8514-aee7e9ac57fd,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:03.452086 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-99337506-a8c7-483e-b674-c68923b32fcb admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=93f6d4f1b1cb4ba29da9d080cb4825b8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5553350
Jun 01 06:13:03.453144 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-38eb2264-2557-476f-b8c6-3966a2504cdf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:03.453583 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 33818) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:03.463730 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-67eb12ce-6cab-46cd-8257-c8dda6428b8b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.072s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:03.537895 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99337506-a8c7-483e-b674-c68923b32fcb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ccc05ae2-c719-4757-950d-a9df9a1d9b41,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:03.556080 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-99337506-a8c7-483e-b674-c68923b32fcb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:03.619731 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-05c5ee00-e81b-4b6d-a7d5-31c85d21f0f1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:03.633051 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9391b21-17fe-4ee3-8f83-85d7de566f12 req-379a2c9a-ba31-4535-b7f7-446b2bf5ad4b tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:03.645679 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d9391b21-17fe-4ee3-8f83-85d7de566f12 req-379a2c9a-ba31-4535-b7f7-446b2bf5ad4b tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.2273154
Jun 01 06:13:03.652795 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-05c5ee00-e81b-4b6d-a7d5-31c85d21f0f1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:03.703396 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d9391b21-17fe-4ee3-8f83-85d7de566f12 req-f2331bbf-4431-45f0-99bd-22d5d99fd093 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0614953
Jun 01 06:13:03.725096 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-05c5ee00-e81b-4b6d-a7d5-31c85d21f0f1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:03.730892 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-03a2dc0b-3b98-48ad-9e4e-70b0609b1de0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:03.736700 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b833266a-9214-4b07-b0db-1d31ea6a1d9a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:03.755658 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05c5ee00-e81b-4b6d-a7d5-31c85d21f0f1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=49528110-75c3-4718-8514-aee7e9ac57fd,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:03.761974 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-05c5ee00-e81b-4b6d-a7d5-31c85d21f0f1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:03.782703 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b833266a-9214-4b07-b0db-1d31ea6a1d9a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:03.794726 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-05c5ee00-e81b-4b6d-a7d5-31c85d21f0f1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:03.798451 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-05c5ee00-e81b-4b6d-a7d5-31c85d21f0f1 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/49528110-75c3-4718-8514-aee7e9ac57fd HTTP/1.1" status: 204  len: 168 time: 0.3540361
Jun 01 06:13:03.856463 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b833266a-9214-4b07-b0db-1d31ea6a1d9a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:03.861693 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-03af1ba4-afeb-4eb4-bb35-132bdc4a0df6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:03.874142 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7501de20-925e-4456-aed1-5bd72b54f5e8 req-0d057872-c5b9-441a-8614-22c1d93e6669 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:03.875865 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7501de20-925e-4456-aed1-5bd72b54f5e8 req-0d057872-c5b9-441a-8614-22c1d93e6669 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=601c5188-c17f-47a6-83cf-a69b68517e08 HTTP/1.1" status: 200  len: 944 time: 0.0947394
Jun 01 06:13:03.877302 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b833266a-9214-4b07-b0db-1d31ea6a1d9a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ccc05ae2-c719-4757-950d-a9df9a1d9b41,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:03.879893 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-b833266a-9214-4b07-b0db-1d31ea6a1d9a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:03.882528 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b833266a-9214-4b07-b0db-1d31ea6a1d9a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:03.884097 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-b833266a-9214-4b07-b0db-1d31ea6a1d9a admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/ccc05ae2-c719-4757-950d-a9df9a1d9b41 HTTP/1.1" status: 204  len: 168 time: 0.4125805
Jun 01 06:13:03.935097 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7501de20-925e-4456-aed1-5bd72b54f5e8 req-1366c451-4727-4836-a90a-672f1ce34b6c tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0448854
Jun 01 06:13:04.299818 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 33846) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:04.319234 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-65fb7265-e889-4f21-bc77-8762caf08695 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:04.336511 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-65fb7265-e889-4f21-bc77-8762caf08695 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:04.341271 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-65fb7265-e889-4f21-bc77-8762caf08695 admin admin] Usage tracker for resource:security_group_rule and tenant:484402df581a4803a493530d20e63ec7 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:04.344138 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-65fb7265-e889-4f21-bc77-8762caf08695 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:04.349803 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-65fb7265-e889-4f21-bc77-8762caf08695 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:04.480632 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-65fb7265-e889-4f21-bc77-8762caf08695 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:04.485950 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-65fb7265-e889-4f21-bc77-8762caf08695 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:04.493386 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-cee4d9a0-b7a1-4f87-a574-316e7ab15ea4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:04.544428 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-65fb7265-e889-4f21-bc77-8762caf08695 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=484402df581a4803a493530d20e63ec7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2434967
Jun 01 06:13:04.545549 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65fb7265-e889-4f21-bc77-8762caf08695 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c3d809a5-5600-49f6-9c3b-964d2115e0b1,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:04.547182 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 33856) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:04.549303 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-65fb7265-e889-4f21-bc77-8762caf08695 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:04.612361 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-2916785c-ea67-462c-b52d-de366add4860 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:04.638660 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-2916785c-ea67-462c-b52d-de366add4860 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:04.703755 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-2916785c-ea67-462c-b52d-de366add4860 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:04.709163 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-7107b134-f013-45c9-a979-5e2037545b9a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:04.725623 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2916785c-ea67-462c-b52d-de366add4860 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c3d809a5-5600-49f6-9c3b-964d2115e0b1,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:04.733688 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 690a6f90-fdb6-46f4-8f05-03e0ab827f78 up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:04.749944 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-2916785c-ea67-462c-b52d-de366add4860 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:04.758067 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-2916785c-ea67-462c-b52d-de366add4860 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:04.759685 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-2916785c-ea67-462c-b52d-de366add4860 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/c3d809a5-5600-49f6-9c3b-964d2115e0b1 HTTP/1.1" status: 204  len: 168 time: 0.2113955
Jun 01 06:13:04.779532 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 33872) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:04.861432 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning for port 690a6f90-fdb6-46f4-8f05-03e0ab827f78 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:13:04.870284 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port 690a6f90-fdb6-46f4-8f05-03e0ab827f78 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:04.870665 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:04.906705 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1811865016-network', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:04.913367 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:04.923721 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Usage tracker for resource:network and tenant:60be617f683c42a081ab3f50c3bdf8f1 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:04.935912 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:04.937872 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f78c009-8f42-44cc-a628-76224f292d42 req-6d1d24cf-f25b-4e23-98fd-9848c0db0a16 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:04.945830 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2f78c009-8f42-44cc-a628-76224f292d42 req-6d1d24cf-f25b-4e23-98fd-9848c0db0a16 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.1092875
Jun 01 06:13:05.006395 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2f78c009-8f42-44cc-a628-76224f292d42 req-7c6102f2-f638-4d88-9a73-a2d7e8afc968 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0591342
Jun 01 06:13:05.089904 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:05.123749 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Made reservation on behalf of 60be617f683c42a081ab3f50c3bdf8f1 for: {'network': 1} {{(pid=92230) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:13:05.127600 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-8110114'] for network, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:05.129610 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:05.166956 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:05.170578 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '601c5188-c17f-47a6-83cf-a69b68517e08', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '690a6f90-fdb6-46f4-8f05-03e0ab827f78'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:13:05.173416 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6addbb30-691e-4e12-a77f-9fc213204e4f" -d '{"events": [{"server_uuid": "601c5188-c17f-47a6-83cf-a69b68517e08", "name": "network-vif-plugged", "status": "completed", "tag": "690a6f90-fdb6-46f4-8f05-03e0ab827f78"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:13:05.183756 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 690a6f90-fdb6-46f4-8f05-03e0ab827f78, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=690a6f90-fdb6-46f4-8f05-03e0ab827f78,segment=NetworkSegment(7e12089c-d8cc-429c-8b7b-f5d148a55957),segment_id=7e12089c-d8cc-429c-8b7b-f5d148a55957)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:13:05.191250 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:05.194877 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:05.203633 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:05.210438 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Usage tracker for resource:security_group_rule and tenant:60be617f683c42a081ab3f50c3bdf8f1 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:05.219375 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:05.227458 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:05.263670 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:13:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6feacf32-111a-4042-9a0c-5fa19f704452 x-openstack-request-id: req-6feacf32-111a-4042-9a0c-5fa19f704452 {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:13:05.264225 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "601c5188-c17f-47a6-83cf-a69b68517e08", "name": "network-vif-plugged", "status": "completed", "tag": "690a6f90-fdb6-46f4-8f05-03e0ab827f78", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:13:05.264690 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-6feacf32-111a-4042-9a0c-5fa19f704452 {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:13:05.265318 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '601c5188-c17f-47a6-83cf-a69b68517e08', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '690a6f90-fdb6-46f4-8f05-03e0ab827f78', 'code': 200}
Jun 01 06:13:05.292783 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-205fbc42-0bb8-41ef-9229-d529b88b7d1c req-5a82184f-6d12-41d1-bf74-5f424d1e822b tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:05.294335 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-205fbc42-0bb8-41ef-9229-d529b88b7d1c req-5a82184f-6d12-41d1-bf74-5f424d1e822b tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=601c5188-c17f-47a6-83cf-a69b68517e08 HTTP/1.1" status: 200  len: 945 time: 0.1214604
Jun 01 06:13:05.321921 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=690a6f90-fdb6-46f4-8f05-03e0ab827f78,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:05.329717 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:05.367950 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-205fbc42-0bb8-41ef-9229-d529b88b7d1c req-a60f02fd-2aa6-441d-8746-df8230b5c10a tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0626047
Jun 01 06:13:05.436746 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:05.442341 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:05.446432 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-37579fb8-a593-4d6c-a635-b29743a443d3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:05.473313 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] vlan segment allocate from pool success with {'vlan_id': 222, 'physical_network': 'physnet1'}  {{(pid=92230) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 06:13:05.491881 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3a46a24c-7372-4850-873a-8fec66fda8c2,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:05.497278 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:05.498276 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:05.498621 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.db.segments_db [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Added segment fd926c6b-9e42-4104-afe3-51ec344ecdd5 of type vlan for network 6200246e-b324-4384-a0a9-6dc6726e2c6d
Jun 01 06:13:05.530284 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8788496565589'] for network, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:05.576986 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104'] for network, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:05.578664 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:05.579125 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:05.584184 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:05.621246 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e65f9200-738c-432c-9ef5-cc05643096e3 req-6d1eb820-e436-41d5-b6ac-496df41b9e2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:05.623445 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e65f9200-738c-432c-9ef5-cc05643096e3 req-6d1eb820-e436-41d5-b6ac-496df41b9e2e service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=601c5188-c17f-47a6-83cf-a69b68517e08 HTTP/1.1" status: 200  len: 1098 time: 0.0971367
Jun 01 06:13:05.686362 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e65f9200-738c-432c-9ef5-cc05643096e3 req-9ff6ca90-f683-41b8-81be-fe3e13f383f6 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0519280
Jun 01 06:13:05.703214 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Pushing event updated for resources: {'Network': ['ID=6200246e-b324-4384-a0a9-6dc6726e2c6d,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:05.708220 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:05.711529 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.9308367
Jun 01 06:13:05.715652 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 33906) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:05.717659 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Network 6200246e-b324-4384-a0a9-6dc6726e2c6d details requested by agent ovs-agent-dv-cinder-793885-1-iscsi with host dv-cinder-793885-1-iscsi {{(pid=92231) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 06:13:05.722921 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-dc8a385a-9121-4bce-a9ca-5c0f5ef5c9b4 admin admin] Request body: {'subnet': {'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1811865016-subnet', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'ip_version': 4}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:05.728921 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-dc8a385a-9121-4bce-a9ca-5c0f5ef5c9b4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:05.733670 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-dc8a385a-9121-4bce-a9ca-5c0f5ef5c9b4 admin admin] Usage tracker for resource:subnet and tenant:60be617f683c42a081ab3f50c3bdf8f1 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:05.737041 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-dc8a385a-9121-4bce-a9ca-5c0f5ef5c9b4 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:05.743694 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-dc8a385a-9121-4bce-a9ca-5c0f5ef5c9b4 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:05.761445 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dc8a385a-9121-4bce-a9ca-5c0f5ef5c9b4 admin admin] Made reservation on behalf of 60be617f683c42a081ab3f50c3bdf8f1 for: {'subnet': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:13:05.764024 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-dc8a385a-9121-4bce-a9ca-5c0f5ef5c9b4 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:06.343313 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c958460-4d09-4509-ad7b-1e96f58ccabc req-efa722af-5b9a-41e1-a359-28ba2db7e9fc tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:06.350335 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5c958460-4d09-4509-ad7b-1e96f58ccabc req-efa722af-5b9a-41e1-a359-28ba2db7e9fc tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.2060626
Jun 01 06:13:06.449597 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5c958460-4d09-4509-ad7b-1e96f58ccabc req-94c0e470-27ac-44d8-a37f-f38cb1e0a9d6 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0981236
Jun 01 06:13:06.480502 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-dc8a385a-9121-4bce-a9ca-5c0f5ef5c9b4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099'] for subnet, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:06.486987 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-65875ccf-c3e3-45c4-a87d-3387f0af1863 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:06.647834 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc8a385a-9121-4bce-a9ca-5c0f5ef5c9b4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1fbcd64f-1378-4ec3-bd16-df65964c6028,revision_number=0']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:06.647834 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-dc8a385a-9121-4bce-a9ca-5c0f5ef5c9b4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:06.662267 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc8a385a-9121-4bce-a9ca-5c0f5ef5c9b4 admin admin] Checking segment: {'id': 'fd926c6b-9e42-4104-afe3-51ec344ecdd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 222, 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:13:06.662624 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc8a385a-9121-4bce-a9ca-5c0f5ef5c9b4 admin admin] Network hostable DHCP agents. Network: 6200246e-b324-4384-a0a9-6dc6726e2c6d, hostable agents: ['648832f0-f26e-4e29-ac0d-d97e4a75c6c4'], hosted agents: [] {{(pid=92229) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 06:13:06.693390 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc8a385a-9121-4bce-a9ca-5c0f5ef5c9b4 admin admin] Network 6200246e-b324-4384-a0a9-6dc6726e2c6d is scheduled to be hosted by DHCP agent 648832f0-f26e-4e29-ac0d-d97e4a75c6c4 with binding_index 1 {{(pid=92229) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 06:13:06.703240 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c9d5ede-d486-4ff4-be59-b3220ccf967c req-a22437dd-f1b3-4aa8-9a42-d70ba1fc2e66 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:06.704805 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2c9d5ede-d486-4ff4-be59-b3220ccf967c req-a22437dd-f1b3-4aa8-9a42-d70ba1fc2e66 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=601c5188-c17f-47a6-83cf-a69b68517e08 HTTP/1.1" status: 200  len: 945 time: 0.1572518
Jun 01 06:13:06.730946 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-dc8a385a-9121-4bce-a9ca-5c0f5ef5c9b4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793885-1-iscsi, 6200246e-b324-4384-a0a9-6dc6726e2c6d) {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:13:06.735414 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc8a385a-9121-4bce-a9ca-5c0f5ef5c9b4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:06.736033 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-dc8a385a-9121-4bce-a9ca-5c0f5ef5c9b4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:06.758154 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f2a62de4-3cb2-4a3e-85d5-20379b3d99c6 None None] Network 6200246e-b324-4384-a0a9-6dc6726e2c6d requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:13:06.781093 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-dc8a385a-9121-4bce-a9ca-5c0f5ef5c9b4 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 1.0630071
Jun 01 06:13:06.784323 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 33940) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:06.787444 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2c9d5ede-d486-4ff4-be59-b3220ccf967c req-d1f7095c-c0a9-47ba-9c44-d26fdab64bfd tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0739188
Jun 01 06:13:06.798463 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1811865016-router', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:06.821327 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:06.826935 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Usage tracker for resource:router and tenant:60be617f683c42a081ab3f50c3bdf8f1 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:06.832320 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:06.861127 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:06.890030 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-748217', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-677'] for router, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:06.891427 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-749241', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-745574', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-726667', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-686'] for router, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:06.918694 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:07.123440 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp5012ce77-b332-5f05-8982-a48a8fc8d50e-6200246e-b324-4384-a0a9-6dc6726e2c6d', 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'fixed_ips': [{'subnet_id': '1fbcd64f-1378-4ec3-bd16-df65964c6028'}]}} from dv-cinder-793885-1-iscsi. {{(pid=92231) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 06:13:07.124337 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:07.316170 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.db_base_plugin_common [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Allocated IP 172.20.0.2 (6200246e-b324-4384-a0a9-6dc6726e2c6d/1fbcd64f-1378-4ec3-bd16-df65964c6028/fe3b640e-c667-450d-ad4a-598acde8045a) {{(pid=92231) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:13:07.316403 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-745539', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-748171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-728'] for router, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:07.613752 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Notify callbacks [] for port, precommit_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:07.637997 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Transition to ACTIVE for port object fe3b640e-c667-450d-ad4a-598acde8045a will not be triggered until provisioned by entity L2. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:13:07.710821 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Transition to ACTIVE for port object fe3b640e-c667-450d-ad4a-598acde8045a will not be triggered until provisioned by entity DHCP. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:13:07.724682 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:07.731431 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:07.747035 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:07.777107 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75b70ea4-ef31-47b5-84a3-3ee55b95d61c req-b295be5f-75d1-440e-ad31-fc9bf17a675a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:07.784387 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-75b70ea4-ef31-47b5-84a3-3ee55b95d61c req-b295be5f-75d1-440e-ad31-fc9bf17a675a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.1562960
Jun 01 06:13:07.836471 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:07.846581 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Network 6200246e-b324-4384-a0a9-6dc6726e2c6d is already hosted by enough agents. {{(pid=92231) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:13:07.854823 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.scheduler.base_scheduler [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Resources bound (agent type, host, resource id):  {{(pid=92231) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:13:07.857315 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-75b70ea4-ef31-47b5-84a3-3ee55b95d61c req-a11bec52-f48a-44f0-90b9-344d8d9aa69a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0719528
Jun 01 06:13:07.883397 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Received port after_create {{(pid=92231) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:13:07.925656 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Pushing event updated for resources: {'Port': ['ID=fe3b640e-c667-450d-ad4a-598acde8045a,revision_number=1']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:07.935340 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.206s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:08.018618 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Attempting to bind port fe3b640e-c667-450d-ad4a-598acde8045a on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:13:08.019441 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Attempting to bind port fe3b640e-c667-450d-ad4a-598acde8045a by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': 'fd926c6b-9e42-4104-afe3-51ec344ecdd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 222, 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d'}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:13:08.019883 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Attempting to bind port fe3b640e-c667-450d-ad4a-598acde8045a on network 6200246e-b324-4384-a0a9-6dc6726e2c6d {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:13:08.027266 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 12, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:13:08.027751 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Checking segment: {'id': 'fd926c6b-9e42-4104-afe3-51ec344ecdd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 222, 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92231) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:13:08.028281 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:08.028779 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Bound using segment: {'id': 'fd926c6b-9e42-4104-afe3-51ec344ecdd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 222, 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d'} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:13:08.029363 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Bound port: fe3b640e-c667-450d-ad4a-598acde8045a, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fd926c6b-9e42-4104-afe3-51ec344ecdd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 222, 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d'}}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:13:08.029820 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:08.103538 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_common [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Allocated IP 172.27.2.74 (83b812fb-2cfc-46e4-baa4-745218ea3ed2/a59d7d11-a92c-4b4f-83cf-2095ecee2b51/2ff74456-d8aa-477a-a634-aca56832439b) {{(pid=92230) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:13:08.157723 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] For port fe3b640e-c667-450d-ad4a-598acde8045a, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92231) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:13:08.162606 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] For port fe3b640e-c667-450d-ad4a-598acde8045a, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=fe3b640e-c667-450d-ad4a-598acde8045a,segment=NetworkSegment(fd926c6b-9e42-4104-afe3-51ec344ecdd5),segment_id=fd926c6b-9e42-4104-afe3-51ec344ecdd5)] {{(pid=92231) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:13:08.163732 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a8a33b-aeb2-48f7-be33-bd07fd20b801 req-4dfe8673-1e1e-4b0f-8a0d-e21e7794da3b tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:08.166505 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a7a8a33b-aeb2-48f7-be33-bd07fd20b801 req-4dfe8673-1e1e-4b0f-8a0d-e21e7794da3b tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=601c5188-c17f-47a6-83cf-a69b68517e08 HTTP/1.1" status: 200  len: 945 time: 0.1934872
Jun 01 06:13:08.168125 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:08.174526 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:08.265348 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a7a8a33b-aeb2-48f7-be33-bd07fd20b801 req-7ad9d7cc-c77c-448d-9487-07bbdd5b959d tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0855961
Jun 01 06:13:08.286988 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Pushing event updated for resources: {'Port': ['ID=fe3b640e-c667-450d-ad4a-598acde8045a,revision_number=2']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:08.294037 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:08.325525 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:08.348525 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-54dca433-a3ac-4f88-89f6-75e224abfdf3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:08.371098 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:08.377086 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:08.443978 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:13:08.445135 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:13:08.450480 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Received port after_create {{(pid=92230) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:13:08.512714 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Pushing event updated for resources: {'Port': ['ID=2ff74456-d8aa-477a-a634-aca56832439b,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:08.522335 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:09.177621 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:09.319228 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-132577a5-b90a-402d-9fda-193921724afe req-0a266893-adf1-4f4c-bca5-2a404b015e08 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:09.320821 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-132577a5-b90a-402d-9fda-193921724afe req-0a266893-adf1-4f4c-bca5-2a404b015e08 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.2392597
Jun 01 06:13:09.393790 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-132577a5-b90a-402d-9fda-193921724afe req-6875f216-7520-419a-9423-5a553e21fa4a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0541034
Jun 01 06:13:09.656784 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-748208', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-745472'] for router, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:09.687277 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-52978a1a-f833-4213-a75f-d781510c5949 None None] Network 6200246e-b324-4384-a0a9-6dc6726e2c6d requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:13:09.816257 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d349255c-e3c2-4114-b7dc-abc1409aed30 None None] Provisioning for port fe3b640e-c667-450d-ad4a-598acde8045a completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:13:09.908609 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Router 4b10a529-195d-4706-87d3-f422588c7516 is scheduled to L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 with binding_index 1 {{(pid=92230) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 06:13:10.132923 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:13:10.136251 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device fe3b640e-c667-450d-ad4a-598acde8045a up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:10.149088 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] Sync routers for ids ['4b10a529-195d-4706-87d3-f422588c7516'] in dv-cinder-793885-1-iscsi {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:13:10.160449 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] Routers {'4b10a529-195d-4706-87d3-f422588c7516'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:13:10.161194 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b29157f0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:12:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['4b10a529-195d-4706-87d3-f422588c7516'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:10.165500 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Notify callbacks [] for router, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:10.169069 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201  len: 920 time: 3.3829114
Jun 01 06:13:10.171021 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34002) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:10.226845 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port fe3b640e-c667-450d-ad4a-598acde8045a completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:13:10.234018 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port fe3b640e-c667-450d-ad4a-598acde8045a triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:10.234486 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:10.318311 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-7fc454c2-5074-4b0e-8938-9c054b133b20 None None] Provisioning complete for port fe3b640e-c667-450d-ad4a-598acde8045a triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:10.319036 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-7fc454c2-5074-4b0e-8938-9c054b133b20 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:10.430410 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] Set router 4b10a529-195d-4706-87d3-f422588c7516 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:13:10.560160 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:10.691453 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-7fc454c2-5074-4b0e-8938-9c054b133b20 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:10.717828 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c975c769-0f19-4580-bcf3-e9ba08b570fe req-ee91a955-2177-4d58-9845-c8707e86bb5e tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:10.730730 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c975c769-0f19-4580-bcf3-e9ba08b570fe req-ee91a955-2177-4d58-9845-c8707e86bb5e tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.1314058
Jun 01 06:13:10.732131 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port fe3b640e-c667-450d-ad4a-598acde8045a, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=fe3b640e-c667-450d-ad4a-598acde8045a,segment=NetworkSegment(fd926c6b-9e42-4104-afe3-51ec344ecdd5),segment_id=fd926c6b-9e42-4104-afe3-51ec344ecdd5)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:13:10.746052 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:10.749060 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:10.811692 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c975c769-0f19-4580-bcf3-e9ba08b570fe req-7fd25f03-9b61-4414-af86-06cfd9deb046 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0798020
Jun 01 06:13:10.888174 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.db.api [None req-7fc454c2-5074-4b0e-8938-9c054b133b20 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=92231) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}}
Jun 01 06:13:10.888570 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_db.api [None req-7fc454c2-5074-4b0e-8938-9c054b133b20 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}}
Jun 01 06:13:10.889189 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=fe3b640e-c667-450d-ad4a-598acde8045a,revision_number=3']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:10.892137 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b29157f0>, [{'id': '4b10a529-195d-4706-87d3-f422588c7516', 'name': 'tempest-TestShelveInstance-1811865016-router', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74'}], 'enable_snat': True}, 'gw_port_id': '2ff74456-d8aa-477a-a634-aca56832439b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:06Z', 'updated_at': '2021-06-01T06:13:08Z', 'revision_number': 3, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'gw_port': {'id': '2ff74456-d8aa-477a-a634-aca56832439b', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:52:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b10a529-195d-4706-87d3-f422588c7516', 'device_owner': 'network:router_gateway', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:07Z', 'updated_at': '2021-06-01T06:13:08Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:10.892337 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:10.896755 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] Checking router: 4b10a529-195d-4706-87d3-f422588c7516 for host: dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:13:10.897103 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] Updating router 4b10a529-195d-4706-87d3-f422588c7516 port 2ff74456-d8aa-477a-a634-aca56832439b binding host dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 06:13:10.960876 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:10.985058 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 34024) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:11.143677 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8b1761ab-091d-4694-a5c5-af1c4c1ed265 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:11.163417 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-8b1761ab-091d-4694-a5c5-af1c4c1ed265 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:11.167677 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-8b1761ab-091d-4694-a5c5-af1c4c1ed265 admin admin] Usage tracker for resource:security_group_rule and tenant:d5c960198419462eb2da8a8c964f50c9 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:11.171006 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-8b1761ab-091d-4694-a5c5-af1c4c1ed265 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:11.177814 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-8b1761ab-091d-4694-a5c5-af1c4c1ed265 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:11.224275 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:11.282835 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:11.359177 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8b1761ab-091d-4694-a5c5-af1c4c1ed265 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:11.365142 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8b1761ab-091d-4694-a5c5-af1c4c1ed265 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:11.379493 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-f393c50e-158f-4b04-b5bd-ac20af5bd1b2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:11.445674 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b1761ab-091d-4694-a5c5-af1c4c1ed265 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bd6e694f-a095-4e07-9121-7afd17ba71ae,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:11.453867 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-8b1761ab-091d-4694-a5c5-af1c4c1ed265 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:11.486282 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-8b1761ab-091d-4694-a5c5-af1c4c1ed265 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=d5c960198419462eb2da8a8c964f50c9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4998562
Jun 01 06:13:11.487196 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 34030) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:11.504050 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] Notify callbacks [] for port, precommit_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:11.522164 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.provisioning_blocks [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] Transition to ACTIVE for port object 2ff74456-d8aa-477a-a634-aca56832439b will not be triggered until provisioned by entity L2. {{(pid=92232) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:13:11.533394 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:11.549173 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:11.603959 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ff6e7afe-941b-47ae-885f-9ff4f7a6f239 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:11.610124 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_common [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] Allocated IP 172.20.0.1 (6200246e-b324-4384-a0a9-6dc6726e2c6d/1fbcd64f-1378-4ec3-bd16-df65964c6028/9708fa96-563b-40e8-9c0f-8540e15e4126) {{(pid=92230) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:13:11.660356 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ff6e7afe-941b-47ae-885f-9ff4f7a6f239 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:11.663807 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] Attempting to bind port 2ff74456-d8aa-477a-a634-aca56832439b on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:13:11.664176 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] Attempting to bind port 2ff74456-d8aa-477a-a634-aca56832439b by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}] {{(pid=92232) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:13:11.664537 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] Attempting to bind port 2ff74456-d8aa-477a-a634-aca56832439b on network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:13:11.676325 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 13, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:13:11.676703 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] Checking segment: {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92232) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:13:11.677129 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:11.677986 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] Bound using segment: {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'} {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:13:11.677986 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] Bound port: 2ff74456-d8aa-477a-a634-aca56832439b, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}}] {{(pid=92232) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:13:11.678347 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:11.707717 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bce0e6a6-578a-437e-8b28-346cf83df3f6 None None] Pushing event updated for resources: {'Port': ['ID=2ff74456-d8aa-477a-a634-aca56832439b,revision_number=2']} {{(pid=92232) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:11.735057 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce0e6a6-578a-437e-8b28-346cf83df3f6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:11.735310 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce0e6a6-578a-437e-8b28-346cf83df3f6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:11.735676 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce0e6a6-578a-437e-8b28-346cf83df3f6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:11.736040 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce0e6a6-578a-437e-8b28-346cf83df3f6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:11.736432 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce0e6a6-578a-437e-8b28-346cf83df3f6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:11.736751 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce0e6a6-578a-437e-8b28-346cf83df3f6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:11.737063 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce0e6a6-578a-437e-8b28-346cf83df3f6 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:11.737385 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce0e6a6-578a-437e-8b28-346cf83df3f6 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:11.737707 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce0e6a6-578a-437e-8b28-346cf83df3f6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:11.738018 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce0e6a6-578a-437e-8b28-346cf83df3f6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:11.738325 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce0e6a6-578a-437e-8b28-346cf83df3f6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:11.738628 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce0e6a6-578a-437e-8b28-346cf83df3f6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:11.745267 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-bce0e6a6-578a-437e-8b28-346cf83df3f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.197s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:11.783853 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.db [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] For port 2ff74456-d8aa-477a-a634-aca56832439b, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92232) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:13:11.786453 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ff6e7afe-941b-47ae-885f-9ff4f7a6f239 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:11.788377 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.db [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] For port 2ff74456-d8aa-477a-a634-aca56832439b, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=2ff74456-d8aa-477a-a634-aca56832439b,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92232) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:13:11.794230 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-2916785c-ea67-462c-b52d-de366add4860 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:11.797635 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:11.808430 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:11.817371 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff6e7afe-941b-47ae-885f-9ff4f7a6f239 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bd6e694f-a095-4e07-9121-7afd17ba71ae,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:11.820601 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ff6e7afe-941b-47ae-885f-9ff4f7a6f239 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:11.823266 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ff6e7afe-941b-47ae-885f-9ff4f7a6f239 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:11.829054 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-ff6e7afe-941b-47ae-885f-9ff4f7a6f239 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/bd6e694f-a095-4e07-9121-7afd17ba71ae HTTP/1.1" status: 204  len: 168 time: 0.3358564
Jun 01 06:13:11.863007 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:11.902375 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.provisioning_blocks [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] Transition to ACTIVE for port object 9708fa96-563b-40e8-9c0f-8540e15e4126 will not be triggered until provisioned by entity DHCP. {{(pid=92230) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:13:11.943924 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:11.954629 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:11.956960 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] Routers {'4b10a529-195d-4706-87d3-f422588c7516'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:13:11.957668 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b29157f0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:12:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['4b10a529-195d-4706-87d3-f422588c7516'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:12.036836 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] Network 6200246e-b324-4384-a0a9-6dc6726e2c6d is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:13:12.039480 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bce0e6a6-578a-437e-8b28-346cf83df3f6 None None] Pushing event updated for resources: {'Port': ['ID=2ff74456-d8aa-477a-a634-aca56832439b,revision_number=3']} {{(pid=92232) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:12.045890 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-bce0e6a6-578a-437e-8b28-346cf83df3f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:12.046470 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:13:12.059020 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] Received port after_create {{(pid=92230) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:13:12.184721 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-744049'] for router_interface, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:12.211340 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] Pushing event updated for resources: {'Port': ['ID=9708fa96-563b-40e8-9c0f-8540e15e4126,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:12.218394 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.265s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:12.224358 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device fe3b640e-c667-450d-ad4a-598acde8045a up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:12.313424 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] Set router 4b10a529-195d-4706-87d3-f422588c7516 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:13:12.379241 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 34042) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:12.437774 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:12.438553 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port fe3b640e-c667-450d-ad4a-598acde8045a triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:12.439114 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:12.439222 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-95a94d9d-5032-4277-81f0-f68620cc9f01 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:12.481691 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-95a94d9d-5032-4277-81f0-f68620cc9f01 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:12.489541 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-95a94d9d-5032-4277-81f0-f68620cc9f01 admin admin] Usage tracker for resource:security_group_rule and tenant:a6d6480a0718495e82dc1993fd211823 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:12.496048 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-95a94d9d-5032-4277-81f0-f68620cc9f01 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:12.507544 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-95a94d9d-5032-4277-81f0-f68620cc9f01 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:12.587103 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-227d424c-a5f1-4ff5-983d-fd7169a8b39a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:12.652616 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-9971d6e9-32c4-4ce7-bfab-1406ad0db4a4 None None] Provisioning for port 9708fa96-563b-40e8-9c0f-8540e15e4126 completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:13:12.664656 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-9971d6e9-32c4-4ce7-bfab-1406ad0db4a4 None None] Provisioning complete for port 9708fa96-563b-40e8-9c0f-8540e15e4126 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:12.665029 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-9971d6e9-32c4-4ce7-bfab-1406ad0db4a4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:12.669375 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-95a94d9d-5032-4277-81f0-f68620cc9f01 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:12.675937 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-95a94d9d-5032-4277-81f0-f68620cc9f01 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:12.694642 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-c4da7997-205a-42b9-9e97-085fd37b9491 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:12.753602 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-9971d6e9-32c4-4ce7-bfab-1406ad0db4a4 None None] Port 9708fa96-563b-40e8-9c0f-8540e15e4126 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:13:12.787055 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-95a94d9d-5032-4277-81f0-f68620cc9f01 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=a6d6480a0718495e82dc1993fd211823&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4061253
Jun 01 06:13:12.789587 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34046) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:12.790402 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95a94d9d-5032-4277-81f0-f68620cc9f01 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f3b7cc6b-5552-446a-b49a-c8aee32bd2a9,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:12.795234 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-95a94d9d-5032-4277-81f0-f68620cc9f01 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:12.799128 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:12.819144 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2416196'] for port, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:12.852743 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:12.871701 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b29157f0>, [{'id': '4b10a529-195d-4706-87d3-f422588c7516', 'name': 'tempest-TestShelveInstance-1811865016-router', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74'}], 'enable_snat': True}, 'gw_port_id': '2ff74456-d8aa-477a-a634-aca56832439b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:06Z', 'updated_at': '2021-06-01T06:13:08Z', 'revision_number': 3, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'gw_port': {'id': '2ff74456-d8aa-477a-a634-aca56832439b', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:52:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b10a529-195d-4706-87d3-f422588c7516', 'device_owner': 'network:router_gateway', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:07Z', 'updated_at': '2021-06-01T06:13:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:12.879272 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee8b3a44-4e1e-4094-8bf4-c6f433716c1a None None] The sync data for ids ['4b10a529-195d-4706-87d3-f422588c7516'] in dv-cinder-793885-1-iscsi is: [{'id': '4b10a529-195d-4706-87d3-f422588c7516', 'name': 'tempest-TestShelveInstance-1811865016-router', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74'}], 'enable_snat': True}, 'gw_port_id': '2ff74456-d8aa-477a-a634-aca56832439b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:06Z', 'updated_at': '2021-06-01T06:13:08Z', 'revision_number': 3, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'gw_port': {'id': '2ff74456-d8aa-477a-a634-aca56832439b', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:52:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b10a529-195d-4706-87d3-f422588c7516', 'device_owner': 'network:router_gateway', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:07Z', 'updated_at': '2021-06-01T06:13:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}] {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:13:12.996722 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-582666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-744156'] for router_interface, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:13.055221 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7a23ecde-11b5-49d1-b235-b5978f496eb9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:13.085358 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] Pushing event updated for resources: {'Port': ['ID=9708fa96-563b-40e8-9c0f-8540e15e4126,revision_number=2']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:13.115435 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.261s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:13.159626 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7a23ecde-11b5-49d1-b235-b5978f496eb9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:13.298507 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:13.581044 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83f1b200-2c99-4806-aa24-1ba2eb3a5e02 req-0b21bc64-bc70-455f-a13d-dbcde7706f6f tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:13.585387 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-83f1b200-2c99-4806-aa24-1ba2eb3a5e02 req-0b21bc64-bc70-455f-a13d-dbcde7706f6f tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.1593115
Jun 01 06:13:13.649472 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] Network 6200246e-b324-4384-a0a9-6dc6726e2c6d is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:13:13.654966 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:13:13.661283 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-83f1b200-2c99-4806-aa24-1ba2eb3a5e02 req-f44394a6-e7b9-4e6b-88da-40ec7fed43c3 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0656264
Jun 01 06:13:13.748135 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7a23ecde-11b5-49d1-b235-b5978f496eb9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:13.757859 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-b5234d8a-aef5-4197-81ff-f4eac977b53e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:13.777282 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a23ecde-11b5-49d1-b235-b5978f496eb9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f3b7cc6b-5552-446a-b49a-c8aee32bd2a9,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:13.782841 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-7a23ecde-11b5-49d1-b235-b5978f496eb9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:13.807441 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7a23ecde-11b5-49d1-b235-b5978f496eb9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:13.808411 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-7a23ecde-11b5-49d1-b235-b5978f496eb9 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/f3b7cc6b-5552-446a-b49a-c8aee32bd2a9 HTTP/1.1" status: 204  len: 168 time: 1.0175381
Jun 01 06:13:13.889811 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-5568673a-5734-4e72-86cc-b645421e5574 None None] Provisioning complete for port 9708fa96-563b-40e8-9c0f-8540e15e4126 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:13.890095 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-5568673a-5734-4e72-86cc-b645421e5574 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:13.974096 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-5568673a-5734-4e72-86cc-b645421e5574 None None] Port 9708fa96-563b-40e8-9c0f-8540e15e4126 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:13:13.981471 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] Router 4b10a529-195d-4706-87d3-f422588c7516 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92230) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:13:14.156754 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 2ff74456-d8aa-477a-a634-aca56832439b up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:14.258999 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port 2ff74456-d8aa-477a-a634-aca56832439b completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:13:14.272223 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 2ff74456-d8aa-477a-a634-aca56832439b triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:14.273105 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:14.283727 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:13:14.295928 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] 10.222.0.25 "PUT /v2.0/routers/4b10a529-195d-4706-87d3-f422588c7516/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.1184978
Jun 01 06:13:14.438630 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:14.456811 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port 2ff74456-d8aa-477a-a634-aca56832439b, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=2ff74456-d8aa-477a-a634-aca56832439b,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:13:14.462167 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:14.465156 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-0f758f4d-8456-4249-be2d-aa8b090a0a44 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:14.556998 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=2ff74456-d8aa-477a-a634-aca56832439b,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:14.564619 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:14.945471 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] Sync routers for ids ['4b10a529-195d-4706-87d3-f422588c7516'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:13:14.954925 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] Routers {'4b10a529-195d-4706-87d3-f422588c7516'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:13:14.955539 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2759160>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:13:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['4b10a529-195d-4706-87d3-f422588c7516'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:14.998905 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34106) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:15.097606 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 34114) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:15.106119 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-2060600636-network', 'tenant_id': 'ba7789f528bf4befb68a21f4c2498c04'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:15.112866 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:15.119421 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Usage tracker for resource:network and tenant:ba7789f528bf4befb68a21f4c2498c04 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:15.124408 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:15.133483 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:15.152113 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Made reservation on behalf of ba7789f528bf4befb68a21f4c2498c04 for: {'network': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:13:15.155469 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-8110114'] for network, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:15.168682 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:15.176882 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] Set router 4b10a529-195d-4706-87d3-f422588c7516 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:13:15.184948 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:15.189260 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Usage tracker for resource:security_group_rule and tenant:ba7789f528bf4befb68a21f4c2498c04 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:15.192338 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:15.200794 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:15.322405 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:15.328317 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:15.333027 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ff6e7afe-941b-47ae-885f-9ff4f7a6f239 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:15.338229 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-886353077-network', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:15.348779 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:15.356087 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Usage tracker for resource:network and tenant:e8bcff3fed924886a68a8562a9f4f8f3 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:15.361838 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:15.363700 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] vlan segment allocate from pool success with {'vlan_id': 212, 'physical_network': 'physnet1'}  {{(pid=92229) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 06:13:15.372909 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:15.373221 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9b08ea87-bef9-46b1-b92d-ba5ca569465b,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:15.378154 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:15.381442 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:15.381877 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.db.segments_db [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Added segment 3df30a41-b01e-4383-92a4-8350393bd930 of type vlan for network 95697b5d-7f1d-4bab-b484-9d0f188c19b6
Jun 01 06:13:15.393736 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:15.397419 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Made reservation on behalf of e8bcff3fed924886a68a8562a9f4f8f3 for: {'network': 1} {{(pid=92230) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:13:15.402761 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-8110114'] for network, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:15.424467 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8788496565589'] for network, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:15.424923 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:15.447380 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:15.452498 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Usage tracker for resource:security_group_rule and tenant:e8bcff3fed924886a68a8562a9f4f8f3 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:15.456303 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:15.464848 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:15.480216 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104'] for network, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:15.481669 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:15.482182 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:15.492255 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:15.583364 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:15.589656 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:15.594886 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-908c7e27-a137-4b71-8a30-c4cbd9a76e52 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:15.606698 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.5077140
Jun 01 06:13:15.610749 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 34118) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:15.617404 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-b698e454-730e-46ee-9b1a-f41487fd89db admin admin] Request body: {'subnet': {'network_id': '95697b5d-7f1d-4bab-b484-9d0f188c19b6', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-2060600636-subnet', 'tenant_id': 'ba7789f528bf4befb68a21f4c2498c04', 'ip_version': 4}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:15.621315 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Pushing event updated for resources: {'Network': ['ID=95697b5d-7f1d-4bab-b484-9d0f188c19b6,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:15.621822 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] vlan segment allocate from pool success with {'vlan_id': 209, 'physical_network': 'physnet1'}  {{(pid=92230) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 06:13:15.625528 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-b698e454-730e-46ee-9b1a-f41487fd89db admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:15.628174 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:15.630796 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-b698e454-730e-46ee-9b1a-f41487fd89db admin admin] Usage tracker for resource:subnet and tenant:ba7789f528bf4befb68a21f4c2498c04 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:15.634844 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-b698e454-730e-46ee-9b1a-f41487fd89db admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:15.637066 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=300675cd-3b27-4591-af6a-7d56779c5314,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:15.641713 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:15.642242 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:15.642576 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.db.segments_db [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Added segment e9a368be-e119-4f56-bdcc-b9d10543e0d8 of type vlan for network 028fef0a-f05a-48d5-ba5c-b539846209ba
Jun 01 06:13:15.648124 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-b698e454-730e-46ee-9b1a-f41487fd89db admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:15.654096 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Network 95697b5d-7f1d-4bab-b484-9d0f188c19b6 details requested by agent ovs-agent-dv-cinder-793885-1-iscsi with host dv-cinder-793885-1-iscsi {{(pid=92231) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 06:13:15.664454 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b698e454-730e-46ee-9b1a-f41487fd89db admin admin] Made reservation on behalf of ba7789f528bf4befb68a21f4c2498c04 for: {'subnet': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:13:15.668934 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b698e454-730e-46ee-9b1a-f41487fd89db admin admin] Notify callbacks [] for subnet, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:15.687557 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8788496565589'] for network, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:15.723510 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104'] for network, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:15.725560 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:15.726634 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:15.746592 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2759160>, [{'id': '4b10a529-195d-4706-87d3-f422588c7516', 'name': 'tempest-TestShelveInstance-1811865016-router', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74'}], 'enable_snat': True}, 'gw_port_id': '2ff74456-d8aa-477a-a634-aca56832439b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:06Z', 'updated_at': '2021-06-01T06:13:12Z', 'revision_number': 4, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'gw_port': {'id': '2ff74456-d8aa-477a-a634-aca56832439b', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:52:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b10a529-195d-4706-87d3-f422588c7516', 'device_owner': 'network:router_gateway', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:07Z', 'updated_at': '2021-06-01T06:13:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '9708fa96-563b-40e8-9c0f-8540e15e4126', 'name': '', 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'mac_address': 'fa:16:3e:06:43:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b10a529-195d-4706-87d3-f422588c7516', 'device_owner': 'network:router_interface', 'standard_attr_id': 315, 'fixed_ips': [{'subnet_id': '1fbcd64f-1378-4ec3-bd16-df65964c6028', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:11Z', 'updated_at': '2021-06-01T06:13:12Z', 'revision_number': 2, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'subnets': [{'id': '1fbcd64f-1378-4ec3-bd16-df65964c6028', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:15.754983 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:15.755382 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] Checking router: 4b10a529-195d-4706-87d3-f422588c7516 for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:13:15.755898 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] Updating router 4b10a529-195d-4706-87d3-f422588c7516 port 9708fa96-563b-40e8-9c0f-8540e15e4126 binding host dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 06:13:15.842617 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:15.855898 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Pushing event updated for resources: {'Network': ['ID=028fef0a-f05a-48d5-ba5c-b539846209ba,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:15.858764 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 0.8579619
Jun 01 06:13:15.859630 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:15.861851 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 34124) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:15.869801 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-2b9883dc-5d7e-4b41-b2d7-8bf63556276d admin admin] Request body: {'subnet': {'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-886353077-subnet', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'ip_version': 4}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:15.880875 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-2b9883dc-5d7e-4b41-b2d7-8bf63556276d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:15.886489 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-2b9883dc-5d7e-4b41-b2d7-8bf63556276d admin admin] Usage tracker for resource:subnet and tenant:e8bcff3fed924886a68a8562a9f4f8f3 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:15.890681 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-2b9883dc-5d7e-4b41-b2d7-8bf63556276d admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:15.892361 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Network 028fef0a-f05a-48d5-ba5c-b539846209ba details requested by agent ovs-agent-dv-cinder-793885-1-iscsi with host dv-cinder-793885-1-iscsi {{(pid=92231) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 06:13:15.896476 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-2b9883dc-5d7e-4b41-b2d7-8bf63556276d admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:15.923177 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2b9883dc-5d7e-4b41-b2d7-8bf63556276d admin admin] Made reservation on behalf of e8bcff3fed924886a68a8562a9f4f8f3 for: {'subnet': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:13:15.925476 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-2b9883dc-5d7e-4b41-b2d7-8bf63556276d admin admin] Notify callbacks [] for subnet, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:16.061590 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:16.120282 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 2ff74456-d8aa-477a-a634-aca56832439b up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:16.334664 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 2ff74456-d8aa-477a-a634-aca56832439b triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:16.335040 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:16.402971 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b698e454-730e-46ee-9b1a-f41487fd89db admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099'] for subnet, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:16.416746 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:16.505862 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b698e454-730e-46ee-9b1a-f41487fd89db admin admin] Pushing event updated for resources: {'Subnet': ['ID=8fbe5513-cda8-4cd9-b261-e9e9b9a9609f,revision_number=0']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:16.511441 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b698e454-730e-46ee-9b1a-f41487fd89db admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:16.514780 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b698e454-730e-46ee-9b1a-f41487fd89db admin admin] Checking segment: {'id': '3df30a41-b01e-4383-92a4-8350393bd930', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 212, 'network_id': '95697b5d-7f1d-4bab-b484-9d0f188c19b6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:13:16.515128 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b698e454-730e-46ee-9b1a-f41487fd89db admin admin] Network hostable DHCP agents. Network: 95697b5d-7f1d-4bab-b484-9d0f188c19b6, hostable agents: ['648832f0-f26e-4e29-ac0d-d97e4a75c6c4'], hosted agents: [] {{(pid=92229) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 06:13:16.554172 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b698e454-730e-46ee-9b1a-f41487fd89db admin admin] Network 95697b5d-7f1d-4bab-b484-9d0f188c19b6 is scheduled to be hosted by DHCP agent 648832f0-f26e-4e29-ac0d-d97e4a75c6c4 with binding_index 1 {{(pid=92229) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 06:13:16.566072 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] Notify callbacks [] for port, precommit_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:16.591862 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] Transition to ACTIVE for port object 9708fa96-563b-40e8-9c0f-8540e15e4126 will not be triggered until provisioned by entity L2. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:13:16.598954 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-b698e454-730e-46ee-9b1a-f41487fd89db admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793885-1-iscsi, 95697b5d-7f1d-4bab-b484-9d0f188c19b6) {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:13:16.602854 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:16.609133 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:16.652474 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b698e454-730e-46ee-9b1a-f41487fd89db admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:16.652580 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b698e454-730e-46ee-9b1a-f41487fd89db admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:16.665354 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e95752d2-bff9-4553-9758-ec4fd2ae296f None None] Network 95697b5d-7f1d-4bab-b484-9d0f188c19b6 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:13:16.753809 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-2b9883dc-5d7e-4b41-b2d7-8bf63556276d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099'] for subnet, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:16.766259 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:16.800236 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-b698e454-730e-46ee-9b1a-f41487fd89db admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 1.1883385
Jun 01 06:13:16.802860 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34132) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:16.809003 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-2060600636-router', 'tenant_id': 'ba7789f528bf4befb68a21f4c2498c04', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:16.815323 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:16.819661 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Usage tracker for resource:router and tenant:ba7789f528bf4befb68a21f4c2498c04 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:16.823247 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:16.829579 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:16.846391 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-748217', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-677'] for router, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:16.848228 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-749241', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-745574', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-726667', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-686'] for router, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:16.859856 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b9883dc-5d7e-4b41-b2d7-8bf63556276d admin admin] Pushing event updated for resources: {'Subnet': ['ID=cdffe000-7f35-495d-a741-b4c48a060887,revision_number=0']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:16.860207 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-2b9883dc-5d7e-4b41-b2d7-8bf63556276d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:16.881401 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:16.906420 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7007a856-a4dc-436c-8864-62f358f28431 None None] Pushing event updated for resources: {'Port': ['ID=9708fa96-563b-40e8-9c0f-8540e15e4126,revision_number=3']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:16.906644 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b9883dc-5d7e-4b41-b2d7-8bf63556276d admin admin] Checking segment: {'id': 'e9a368be-e119-4f56-bdcc-b9d10543e0d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 209, 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:13:16.906948 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b9883dc-5d7e-4b41-b2d7-8bf63556276d admin admin] Network hostable DHCP agents. Network: 028fef0a-f05a-48d5-ba5c-b539846209ba, hostable agents: ['648832f0-f26e-4e29-ac0d-d97e4a75c6c4'], hosted agents: [] {{(pid=92229) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 06:13:16.924421 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-7007a856-a4dc-436c-8864-62f358f28431 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.315s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:16.938750 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb12117a-7ade-4bad-b409-b772ed43a2a8 req-620047fd-21e4-42f3-8b76-4d7ebad75f52 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:16.947332 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fb12117a-7ade-4bad-b409-b772ed43a2a8 req-620047fd-21e4-42f3-8b76-4d7ebad75f52 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.3520741
Jun 01 06:13:17.011380 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] Attempting to bind port 9708fa96-563b-40e8-9c0f-8540e15e4126 on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:13:17.011749 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] Attempting to bind port 9708fa96-563b-40e8-9c0f-8540e15e4126 by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': 'fd926c6b-9e42-4104-afe3-51ec344ecdd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 222, 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d'}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:13:17.012364 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] Attempting to bind port 9708fa96-563b-40e8-9c0f-8540e15e4126 on network 6200246e-b324-4384-a0a9-6dc6726e2c6d {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:13:17.020630 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 13, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:13:17.021326 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] Checking segment: {'id': 'fd926c6b-9e42-4104-afe3-51ec344ecdd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 222, 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92231) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:13:17.021896 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:17.022475 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] Bound using segment: {'id': 'fd926c6b-9e42-4104-afe3-51ec344ecdd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 222, 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d'} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:13:17.023136 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] Bound port: 9708fa96-563b-40e8-9c0f-8540e15e4126, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fd926c6b-9e42-4104-afe3-51ec344ecdd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 222, 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d'}}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:13:17.023692 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:17.110775 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fb12117a-7ade-4bad-b409-b772ed43a2a8 req-c4eb017e-0fd1-4cc3-983c-6b27cc70d57f tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1623800
Jun 01 06:13:17.112070 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b9883dc-5d7e-4b41-b2d7-8bf63556276d admin admin] Network 028fef0a-f05a-48d5-ba5c-b539846209ba is scheduled to be hosted by DHCP agent 648832f0-f26e-4e29-ac0d-d97e4a75c6c4 with binding_index 1 {{(pid=92229) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 06:13:17.134325 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-2b9883dc-5d7e-4b41-b2d7-8bf63556276d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793885-1-iscsi, 028fef0a-f05a-48d5-ba5c-b539846209ba) {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:13:17.139216 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b9883dc-5d7e-4b41-b2d7-8bf63556276d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:17.140032 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-2b9883dc-5d7e-4b41-b2d7-8bf63556276d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:17.159306 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f2258f7d-5272-46ca-8cb3-9353e14c5de4 None None] Network 028fef0a-f05a-48d5-ba5c-b539846209ba requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:13:17.169905 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-2b9883dc-5d7e-4b41-b2d7-8bf63556276d admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 847 time: 1.3064547
Jun 01 06:13:17.172081 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 34140) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:17.180453 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:17.190301 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:17.195694 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Usage tracker for resource:router and tenant:e8bcff3fed924886a68a8562a9f4f8f3 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:17.202649 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:17.211172 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:17.223946 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-745539', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-748171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-728'] for router, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:17.227426 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-748217', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-677'] for router, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:17.232646 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-749241', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-745574', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-726667', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-686'] for router, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:17.258517 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:17.354635 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp5012ce77-b332-5f05-8982-a48a8fc8d50e-95697b5d-7f1d-4bab-b484-9d0f188c19b6', 'network_id': '95697b5d-7f1d-4bab-b484-9d0f188c19b6', 'tenant_id': 'ba7789f528bf4befb68a21f4c2498c04', 'fixed_ips': [{'subnet_id': '8fbe5513-cda8-4cd9-b261-e9e9b9a9609f'}]}} from dv-cinder-793885-1-iscsi. {{(pid=92231) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 06:13:17.355405 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:17.371509 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] For port 9708fa96-563b-40e8-9c0f-8540e15e4126, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92231) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:13:17.414075 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] For port 9708fa96-563b-40e8-9c0f-8540e15e4126, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=9708fa96-563b-40e8-9c0f-8540e15e4126,segment=NetworkSegment(fd926c6b-9e42-4104-afe3-51ec344ecdd5),segment_id=fd926c6b-9e42-4104-afe3-51ec344ecdd5)] {{(pid=92231) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:13:17.430022 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:17.479626 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:17.773070 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] Routers {'4b10a529-195d-4706-87d3-f422588c7516'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:13:17.775486 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2759160>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:13:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['4b10a529-195d-4706-87d3-f422588c7516'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:17.873171 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-745539', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-748171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-728'] for router, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:17.923491 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:18.001713 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:18.017293 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7007a856-a4dc-436c-8864-62f358f28431 None None] Pushing event updated for resources: {'Port': ['ID=9708fa96-563b-40e8-9c0f-8540e15e4126,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:18.044544 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-7007a856-a4dc-436c-8864-62f358f28431 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.570s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:18.066923 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp5012ce77-b332-5f05-8982-a48a8fc8d50e-028fef0a-f05a-48d5-ba5c-b539846209ba', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887'}]}} from dv-cinder-793885-1-iscsi. {{(pid=92231) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 06:13:18.067683 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:18.080830 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f632cac1-00fa-46b8-83a5-6aaa17c26f99 req-ed21ecde-3c30-4bf2-8803-6e1abe0a8bcc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:18.082327 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f632cac1-00fa-46b8-83a5-6aaa17c26f99 req-ed21ecde-3c30-4bf2-8803-6e1abe0a8bcc service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 1098 time: 0.3391747
Jun 01 06:13:18.184807 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f632cac1-00fa-46b8-83a5-6aaa17c26f99 req-347c979f-ff0c-43ce-b993-6ecb2057aac3 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0825224
Jun 01 06:13:18.225169 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_common [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Allocated IP 172.27.2.18 (83b812fb-2cfc-46e4-baa4-745218ea3ed2/a59d7d11-a92c-4b4f-83cf-2095ecee2b51/962c60b2-2fe3-4cde-a7fb-73010b6c5779) {{(pid=92230) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:13:18.395451 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Notify callbacks [] for port, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:18.396810 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.db_base_plugin_common [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Allocated IP 172.20.0.2 (95697b5d-7f1d-4bab-b484-9d0f188c19b6/8fbe5513-cda8-4cd9-b261-e9e9b9a9609f/4ba492f1-8627-418b-b6d8-63900e8f34eb) {{(pid=92231) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:13:18.432463 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] Set router 4b10a529-195d-4706-87d3-f422588c7516 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:13:18.453458 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:18.461657 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:18.464622 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d6ec593-0b78-4c6a-9184-a9eab79803e7 req-4ccc8623-c4d1-4854-b358-11a693afae75 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:18.466191 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5d6ec593-0b78-4c6a-9184-a9eab79803e7 req-4ccc8623-c4d1-4854-b358-11a693afae75 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.2145605
Jun 01 06:13:18.469605 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:18.518851 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:18.583432 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:13:18.589553 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:13:18.596844 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Received port after_create {{(pid=92230) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:13:18.627942 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5d6ec593-0b78-4c6a-9184-a9eab79803e7 req-74144ca6-5820-462c-ad03-f352bab2ba8f tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1318464
Jun 01 06:13:18.700168 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Pushing event updated for resources: {'Port': ['ID=962c60b2-2fe3-4cde-a7fb-73010b6c5779,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:18.705240 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.243s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:18.728786 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Allocated IP 172.27.2.171 (83b812fb-2cfc-46e4-baa4-745218ea3ed2/a59d7d11-a92c-4b4f-83cf-2095ecee2b51/11fed125-e49d-4bbd-8888-eac8a4fe11e9) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:13:18.816185 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.db_base_plugin_common [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Allocated IP 172.20.0.2 (028fef0a-f05a-48d5-ba5c-b539846209ba/cdffe000-7f35-495d-a741-b4c48a060887/aef202dd-622d-40c5-bcd0-3e6b5c08efe2) {{(pid=92231) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:13:18.984906 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:19.003594 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Notify callbacks [] for port, precommit_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:19.015538 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Transition to ACTIVE for port object 4ba492f1-8627-418b-b6d8-63900e8f34eb will not be triggered until provisioned by entity L2. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:13:19.048394 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:19.061627 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:19.119974 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Transition to ACTIVE for port object 4ba492f1-8627-418b-b6d8-63900e8f34eb will not be triggered until provisioned by entity DHCP. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:13:19.164036 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:19.183294 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:19.274508 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Pushing event updated for resources: {'Port': ['ID=11fed125-e49d-4bbd-8888-eac8a4fe11e9,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:19.280374 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.219s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:19.280678 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:19.282967 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:13:19.284922 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:13:19.293753 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:13:19.293972 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Network 95697b5d-7f1d-4bab-b484-9d0f188c19b6 is already hosted by enough agents. {{(pid=92231) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:13:19.307465 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.scheduler.base_scheduler [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Resources bound (agent type, host, resource id):  {{(pid=92231) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:13:19.318934 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Received port after_create {{(pid=92231) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:13:19.321295 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Pushing event updated for resources: {'Port': ['ID=4ba492f1-8627-418b-b6d8-63900e8f34eb,revision_number=1']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:19.328547 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:19.534264 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Attempting to bind port 4ba492f1-8627-418b-b6d8-63900e8f34eb on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:13:19.534710 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Attempting to bind port 4ba492f1-8627-418b-b6d8-63900e8f34eb by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': '3df30a41-b01e-4383-92a4-8350393bd930', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 212, 'network_id': '95697b5d-7f1d-4bab-b484-9d0f188c19b6'}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:13:19.535075 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Attempting to bind port 4ba492f1-8627-418b-b6d8-63900e8f34eb on network 95697b5d-7f1d-4bab-b484-9d0f188c19b6 {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:13:19.546278 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Notify callbacks [] for port, precommit_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:19.555625 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 13, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:13:19.555625 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Checking segment: {'id': '3df30a41-b01e-4383-92a4-8350393bd930', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 212, 'network_id': '95697b5d-7f1d-4bab-b484-9d0f188c19b6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92231) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:13:19.556187 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:19.556518 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Bound using segment: {'id': '3df30a41-b01e-4383-92a4-8350393bd930', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 212, 'network_id': '95697b5d-7f1d-4bab-b484-9d0f188c19b6'} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:13:19.561184 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Bound port: 4ba492f1-8627-418b-b6d8-63900e8f34eb, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3df30a41-b01e-4383-92a4-8350393bd930', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 212, 'network_id': '95697b5d-7f1d-4bab-b484-9d0f188c19b6'}}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:13:19.562495 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:19.585110 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2759160>, [{'id': '4b10a529-195d-4706-87d3-f422588c7516', 'name': 'tempest-TestShelveInstance-1811865016-router', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74'}], 'enable_snat': True}, 'gw_port_id': '2ff74456-d8aa-477a-a634-aca56832439b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:06Z', 'updated_at': '2021-06-01T06:13:12Z', 'revision_number': 4, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'gw_port': {'id': '2ff74456-d8aa-477a-a634-aca56832439b', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:52:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b10a529-195d-4706-87d3-f422588c7516', 'device_owner': 'network:router_gateway', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:07Z', 'updated_at': '2021-06-01T06:13:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '9708fa96-563b-40e8-9c0f-8540e15e4126', 'name': '', 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'mac_address': 'fa:16:3e:06:43:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b10a529-195d-4706-87d3-f422588c7516', 'device_owner': 'network:router_interface', 'standard_attr_id': 315, 'fixed_ips': [{'subnet_id': '1fbcd64f-1378-4ec3-bd16-df65964c6028', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:11Z', 'updated_at': '2021-06-01T06:13:17Z', 'revision_number': 4, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'subnets': [{'id': '1fbcd64f-1378-4ec3-bd16-df65964c6028', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:19.594242 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Transition to ACTIVE for port object aef202dd-622d-40c5-bcd0-3e6b5c08efe2 will not be triggered until provisioned by entity L2. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:13:19.622369 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Transition to ACTIVE for port object aef202dd-622d-40c5-bcd0-3e6b5c08efe2 will not be triggered until provisioned by entity DHCP. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:13:19.678941 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:19.688441 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:19.773716 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-748208', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-745472'] for router, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:19.795876 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] For port 4ba492f1-8627-418b-b6d8-63900e8f34eb, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92231) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:13:19.799593 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] For port 4ba492f1-8627-418b-b6d8-63900e8f34eb, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=4ba492f1-8627-418b-b6d8-63900e8f34eb,segment=NetworkSegment(3df30a41-b01e-4383-92a4-8350393bd930),segment_id=3df30a41-b01e-4383-92a4-8350393bd930)] {{(pid=92231) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:13:19.809436 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ef67137-1d88-4147-9b0b-d356526a82e7 None None] The sync data for ids ['4b10a529-195d-4706-87d3-f422588c7516'] in dv-cinder-793885-1-iscsi is: [{'id': '4b10a529-195d-4706-87d3-f422588c7516', 'name': 'tempest-TestShelveInstance-1811865016-router', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74'}], 'enable_snat': True}, 'gw_port_id': '2ff74456-d8aa-477a-a634-aca56832439b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:06Z', 'updated_at': '2021-06-01T06:13:12Z', 'revision_number': 4, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'gw_port': {'id': '2ff74456-d8aa-477a-a634-aca56832439b', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:52:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b10a529-195d-4706-87d3-f422588c7516', 'device_owner': 'network:router_gateway', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:07Z', 'updated_at': '2021-06-01T06:13:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '9708fa96-563b-40e8-9c0f-8540e15e4126', 'name': '', 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'mac_address': 'fa:16:3e:06:43:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b10a529-195d-4706-87d3-f422588c7516', 'device_owner': 'network:router_interface', 'standard_attr_id': 315, 'fixed_ips': [{'subnet_id': '1fbcd64f-1378-4ec3-bd16-df65964c6028', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:11Z', 'updated_at': '2021-06-01T06:13:17Z', 'revision_number': 4, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'subnets': [{'id': '1fbcd64f-1378-4ec3-bd16-df65964c6028', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:13:19.831483 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:19.872993 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Network 028fef0a-f05a-48d5-ba5c-b539846209ba is already hosted by enough agents. {{(pid=92231) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:13:19.874873 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.scheduler.base_scheduler [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Resources bound (agent type, host, resource id):  {{(pid=92231) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:13:19.895107 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Received port after_create {{(pid=92231) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:13:20.000499 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Pushing event updated for resources: {'Port': ['ID=aef202dd-622d-40c5-bcd0-3e6b5c08efe2,revision_number=1']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:20.027835 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.339s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:20.049169 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-f318493e-63e3-496e-b4a7-301e734e8e3f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.208s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:20.069236 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:20.091875 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Attempting to bind port aef202dd-622d-40c5-bcd0-3e6b5c08efe2 on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:13:20.091875 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Attempting to bind port aef202dd-622d-40c5-bcd0-3e6b5c08efe2 by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': 'e9a368be-e119-4f56-bdcc-b9d10543e0d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 209, 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba'}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:13:20.092231 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Attempting to bind port aef202dd-622d-40c5-bcd0-3e6b5c08efe2 on network 028fef0a-f05a-48d5-ba5c-b539846209ba {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:13:20.125365 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 13, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:13:20.125910 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Checking segment: {'id': 'e9a368be-e119-4f56-bdcc-b9d10543e0d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 209, 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92231) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:13:20.126440 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:20.126957 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Bound using segment: {'id': 'e9a368be-e119-4f56-bdcc-b9d10543e0d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 209, 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba'} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:13:20.130850 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Bound port: aef202dd-622d-40c5-bcd0-3e6b5c08efe2, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e9a368be-e119-4f56-bdcc-b9d10543e0d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 209, 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba'}}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:13:20.131664 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:20.261380 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Pushing event updated for resources: {'Port': ['ID=4ba492f1-8627-418b-b6d8-63900e8f34eb,revision_number=2']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:20.276310 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 9708fa96-563b-40e8-9c0f-8540e15e4126 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:20.467008 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.418s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:20.498805 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Router 1332a475-4493-4edf-9b3e-9cabb6f0ef57 is scheduled to L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 with binding_index 1 {{(pid=92230) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 06:13:20.616320 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] For port aef202dd-622d-40c5-bcd0-3e6b5c08efe2, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92231) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:13:20.622512 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] For port aef202dd-622d-40c5-bcd0-3e6b5c08efe2, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=aef202dd-622d-40c5-bcd0-3e6b5c08efe2,segment=NetworkSegment(e9a368be-e119-4f56-bdcc-b9d10543e0d8),segment_id=e9a368be-e119-4f56-bdcc-b9d10543e0d8)] {{(pid=92231) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:13:20.638076 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:20.660310 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:20.704827 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port 9708fa96-563b-40e8-9c0f-8540e15e4126 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:13:20.723597 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:13:20.751373 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 9708fa96-563b-40e8-9c0f-8540e15e4126 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:20.751748 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:20.798842 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-748208', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-745472'] for router, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:20.826250 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Pushing event updated for resources: {'Port': ['ID=aef202dd-622d-40c5-bcd0-3e6b5c08efe2,revision_number=2']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:20.838735 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:20.936628 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:13:20.937375 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afb56a0d-2a0b-4b73-942e-b7831f7344ea req-8f4360bc-9862-4f9d-b849-23c90ac252c2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:20.939107 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-afb56a0d-2a0b-4b73-942e-b7831f7344ea req-8f4360bc-9862-4f9d-b849-23c90ac252c2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 1.1352463
Jun 01 06:13:20.951496 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] Sync routers for ids ['1332a475-4493-4edf-9b3e-9cabb6f0ef57'] in dv-cinder-793885-1-iscsi {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:13:20.969693 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] Routers {'1332a475-4493-4edf-9b3e-9cabb6f0ef57'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:13:20.970328 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2906ee0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:13:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['1332a475-4493-4edf-9b3e-9cabb6f0ef57'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:20.981295 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:21.037513 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port 9708fa96-563b-40e8-9c0f-8540e15e4126, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=9708fa96-563b-40e8-9c0f-8540e15e4126,segment=NetworkSegment(fd926c6b-9e42-4104-afe3-51ec344ecdd5),segment_id=fd926c6b-9e42-4104-afe3-51ec344ecdd5)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:13:21.058342 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:21.077766 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:21.079553 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Notify callbacks [] for router, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:21.100260 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201  len: 920 time: 4.2939341
Jun 01 06:13:21.113694 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34212) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:21.318383 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-afb56a0d-2a0b-4b73-942e-b7831f7344ea req-e44fa87f-ffdc-47ba-b30f-15e8e18fc1f2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3653026
Jun 01 06:13:21.390338 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=9708fa96-563b-40e8-9c0f-8540e15e4126,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:21.402132 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.332s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:21.490313 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Router 00ab7a71-e7f7-4524-99c9-7562f23905d1 is scheduled to L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 with binding_index 1 {{(pid=92229) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 06:13:21.638404 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] Set router 1332a475-4493-4edf-9b3e-9cabb6f0ef57 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:13:21.935508 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7487c3d3-a3f7-4d7e-8c5e-601dc3dd0de8 None None] Network 95697b5d-7f1d-4bab-b484-9d0f188c19b6 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:13:22.156429 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cacc2e1-4516-48fc-b88a-ef54c6a002ce req-d46007c7-8dd5-44df-9e48-4106c2283f3f tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:22.157629 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-982eef24-c903-41a0-965b-d42fb6f3a2e4 None None] Provisioning for port 4ba492f1-8627-418b-b6d8-63900e8f34eb completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:13:22.168566 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6cacc2e1-4516-48fc-b88a-ef54c6a002ce req-d46007c7-8dd5-44df-9e48-4106c2283f3f tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.5696282
Jun 01 06:13:22.251710 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2906ee0>, [{'id': '1332a475-4493-4edf-9b3e-9cabb6f0ef57', 'name': 'tempest-TestShelveInstance-2060600636-router', 'tenant_id': 'ba7789f528bf4befb68a21f4c2498c04', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.18'}], 'enable_snat': True}, 'gw_port_id': '962c60b2-2fe3-4cde-a7fb-73010b6c5779', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:16Z', 'updated_at': '2021-06-01T06:13:18Z', 'revision_number': 3, 'project_id': 'ba7789f528bf4befb68a21f4c2498c04', 'gw_port': {'id': '962c60b2-2fe3-4cde-a7fb-73010b6c5779', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:f2:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1332a475-4493-4edf-9b3e-9cabb6f0ef57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 340, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.18', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:18Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:22.259881 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] Checking router: 1332a475-4493-4edf-9b3e-9cabb6f0ef57 for host: dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:13:22.260458 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] Updating router 1332a475-4493-4edf-9b3e-9cabb6f0ef57 port 962c60b2-2fe3-4cde-a7fb-73010b6c5779 binding host dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 06:13:22.260907 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92229) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:13:22.331327 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Notify callbacks [] for router, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:22.338736 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] Sync routers for ids ['00ab7a71-e7f7-4524-99c9-7562f23905d1'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:13:22.340561 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201  len: 923 time: 5.1670296
Jun 01 06:13:22.346438 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 34238) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:22.376400 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6cacc2e1-4516-48fc-b88a-ef54c6a002ce req-3fc78b72-2136-43e1-83a0-c1c6309554e9 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2040043
Jun 01 06:13:22.418683 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] Routers {'00ab7a71-e7f7-4524-99c9-7562f23905d1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:13:22.420228 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b1820880>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:13:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['00ab7a71-e7f7-4524-99c9-7562f23905d1'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:22.491685 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8faa8f5d-2dec-4882-8fd8-21079e22502e None None] Network 028fef0a-f05a-48d5-ba5c-b539846209ba requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:13:22.497296 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:22.541428 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 4ba492f1-8627-418b-b6d8-63900e8f34eb up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:22.755769 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:23.173663 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-08b13a58-39a8-4011-ab54-38d89a955b99 None None] Provisioning for port aef202dd-622d-40c5-bcd0-3e6b5c08efe2 completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:13:23.235900 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_common [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] Allocated IP 172.20.0.1 (95697b5d-7f1d-4bab-b484-9d0f188c19b6/8fbe5513-cda8-4cd9-b261-e9e9b9a9609f/a75c6cfb-ca4a-4dc4-981a-b8362697c093) {{(pid=92230) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:13:23.457195 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] Notify callbacks [] for port, precommit_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:23.473839 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] Set router 00ab7a71-e7f7-4524-99c9-7562f23905d1 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:13:23.486382 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.provisioning_blocks [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] Transition to ACTIVE for port object 962c60b2-2fe3-4cde-a7fb-73010b6c5779 will not be triggered until provisioned by entity L2. {{(pid=92232) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:13:23.512664 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:23.517736 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-bce0e6a6-578a-437e-8b28-346cf83df3f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:23.580731 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:23.612899 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.provisioning_blocks [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] Transition to ACTIVE for port object a75c6cfb-ca4a-4dc4-981a-b8362697c093 will not be triggered until provisioned by entity DHCP. {{(pid=92230) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:13:23.654453 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:23.661461 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-8dbc2deb-1982-4449-b290-b2901742f9dc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:23.751934 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6379039-d39d-4aa2-a76a-fc29056b13fe None None] Pushing event updated for resources: {'Port': ['ID=962c60b2-2fe3-4cde-a7fb-73010b6c5779,revision_number=2']} {{(pid=92232) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:23.756210 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port 4ba492f1-8627-418b-b6d8-63900e8f34eb completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:13:23.793296 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-a6379039-d39d-4aa2-a76a-fc29056b13fe None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.263s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:23.803286 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] Pushing event updated for resources: {'Port': ['ID=a75c6cfb-ca4a-4dc4-981a-b8362697c093,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:23.810360 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:23.819276 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] Network 95697b5d-7f1d-4bab-b484-9d0f188c19b6 is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:13:23.820482 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:13:23.820612 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] Attempting to bind port 962c60b2-2fe3-4cde-a7fb-73010b6c5779 on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:13:23.820994 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] Attempting to bind port 962c60b2-2fe3-4cde-a7fb-73010b6c5779 by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}] {{(pid=92232) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:13:23.821354 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] Attempting to bind port 962c60b2-2fe3-4cde-a7fb-73010b6c5779 on network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:13:23.823122 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] Received port after_create {{(pid=92230) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:13:23.848207 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 13, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:13:23.849946 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] Checking segment: {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92232) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:13:23.850356 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:23.850775 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] Bound using segment: {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'} {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:13:23.851303 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] Bound port: 962c60b2-2fe3-4cde-a7fb-73010b6c5779, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}}] {{(pid=92232) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:13:23.855247 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 4ba492f1-8627-418b-b6d8-63900e8f34eb triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:23.855630 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:23.862865 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:23.878786 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-744049'] for router_interface, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:24.083533 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.db [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] For port 962c60b2-2fe3-4cde-a7fb-73010b6c5779, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92232) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:13:24.093845 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.db [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] For port 962c60b2-2fe3-4cde-a7fb-73010b6c5779, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=962c60b2-2fe3-4cde-a7fb-73010b6c5779,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92232) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:13:24.105671 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:24.110079 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:24.137352 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-165205a5-e3f1-4a1a-b169-f611156b79e8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:24.329217 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] Routers {'1332a475-4493-4edf-9b3e-9cabb6f0ef57'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:13:24.329882 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2906ee0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:13:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['1332a475-4493-4edf-9b3e-9cabb6f0ef57'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:24.353352 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:24.602700 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:24.611875 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Allocated IP 172.20.0.1 (028fef0a-f05a-48d5-ba5c-b539846209ba/cdffe000-7f35-495d-a741-b4c48a060887/cd6dda6e-46d3-4412-9652-c686f5fad712) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:13:24.623328 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-57957f5e-0498-473e-bd75-495cdb777c0c None None] Provisioning complete for port 4ba492f1-8627-418b-b6d8-63900e8f34eb triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:24.631377 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-57957f5e-0498-473e-bd75-495cdb777c0c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:24.815816 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] Set router 1332a475-4493-4edf-9b3e-9cabb6f0ef57 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:13:24.829541 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port 4ba492f1-8627-418b-b6d8-63900e8f34eb, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=4ba492f1-8627-418b-b6d8-63900e8f34eb,segment=NetworkSegment(3df30a41-b01e-4383-92a4-8350393bd930),segment_id=3df30a41-b01e-4383-92a4-8350393bd930)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:13:24.841817 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:24.855248 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 9708fa96-563b-40e8-9c0f-8540e15e4126 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:24.859124 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:24.867605 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2416196'] for port, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:24.939043 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:24.944967 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-4f85d918-780f-46cd-ba81-f3b4f6d4d2d2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:24.986274 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:25.006661 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Transition to ACTIVE for port object cd6dda6e-46d3-4412-9652-c686f5fad712 will not be triggered until provisioned by entity DHCP. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:13:25.028999 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b1820880>, [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:19Z', 'revision_number': 3, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:18Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:25.037053 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:25.045227 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:25.145543 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-582666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-744156'] for router_interface, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:25.159547 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6379039-d39d-4aa2-a76a-fc29056b13fe None None] Pushing event updated for resources: {'Port': ['ID=962c60b2-2fe3-4cde-a7fb-73010b6c5779,revision_number=3']} {{(pid=92232) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:25.162193 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Network 028fef0a-f05a-48d5-ba5c-b539846209ba is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:13:25.168139 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-a6379039-d39d-4aa2-a76a-fc29056b13fe None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.031s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:25.170376 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] Pushing event updated for resources: {'Port': ['ID=a75c6cfb-ca4a-4dc4-981a-b8362697c093,revision_number=2']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:25.177493 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:13:25.178901 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.236s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:25.198418 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:13:25.199047 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-744049'] for router_interface, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:25.244589 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] Checking router: 00ab7a71-e7f7-4524-99c9-7562f23905d1 for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:13:25.244981 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] Updating router 00ab7a71-e7f7-4524-99c9-7562f23905d1 port 11fed125-e49d-4bbd-8888-eac8a4fe11e9 binding host dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 06:13:25.350755 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Pushing event updated for resources: {'Port': ['ID=cd6dda6e-46d3-4412-9652-c686f5fad712,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:25.370476 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:25.370761 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:25.371116 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:25.371461 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:25.371819 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:25.372170 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:25.372508 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:25.372845 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:25.373182 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:25.373516 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:25.373850 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:25.379680 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:25.414891 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.370s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:25.466904 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:25.521291 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2906ee0>, [{'id': '1332a475-4493-4edf-9b3e-9cabb6f0ef57', 'name': 'tempest-TestShelveInstance-2060600636-router', 'tenant_id': 'ba7789f528bf4befb68a21f4c2498c04', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.18'}], 'enable_snat': True}, 'gw_port_id': '962c60b2-2fe3-4cde-a7fb-73010b6c5779', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:16Z', 'updated_at': '2021-06-01T06:13:23Z', 'revision_number': 4, 'project_id': 'ba7789f528bf4befb68a21f4c2498c04', 'gw_port': {'id': '962c60b2-2fe3-4cde-a7fb-73010b6c5779', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:f2:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1332a475-4493-4edf-9b3e-9cabb6f0ef57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 340, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.18', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': 'a75c6cfb-ca4a-4dc4-981a-b8362697c093', 'name': '', 'network_id': '95697b5d-7f1d-4bab-b484-9d0f188c19b6', 'tenant_id': 'ba7789f528bf4befb68a21f4c2498c04', 'mac_address': 'fa:16:3e:8a:6b:69', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1332a475-4493-4edf-9b3e-9cabb6f0ef57', 'device_owner': 'network:router_interface', 'standard_attr_id': 343, 'fixed_ips': [{'subnet_id': '8fbe5513-cda8-4cd9-b261-e9e9b9a9609f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:22Z', 'updated_at': '2021-06-01T06:13:23Z', 'revision_number': 1, 'project_id': 'ba7789f528bf4befb68a21f4c2498c04', 'subnets': [{'id': '8fbe5513-cda8-4cd9-b261-e9e9b9a9609f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:25.529866 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] Network 95697b5d-7f1d-4bab-b484-9d0f188c19b6 is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:13:25.532870 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:13:25.544992 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c72acb7d-f475-45c6-8480-2f6c8a8194ac None None] The sync data for ids ['1332a475-4493-4edf-9b3e-9cabb6f0ef57'] in dv-cinder-793885-1-iscsi is: [{'id': '1332a475-4493-4edf-9b3e-9cabb6f0ef57', 'name': 'tempest-TestShelveInstance-2060600636-router', 'tenant_id': 'ba7789f528bf4befb68a21f4c2498c04', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.18'}], 'enable_snat': True}, 'gw_port_id': '962c60b2-2fe3-4cde-a7fb-73010b6c5779', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:16Z', 'updated_at': '2021-06-01T06:13:23Z', 'revision_number': 4, 'project_id': 'ba7789f528bf4befb68a21f4c2498c04', 'gw_port': {'id': '962c60b2-2fe3-4cde-a7fb-73010b6c5779', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:f2:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1332a475-4493-4edf-9b3e-9cabb6f0ef57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 340, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.18', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': 'a75c6cfb-ca4a-4dc4-981a-b8362697c093', 'name': '', 'network_id': '95697b5d-7f1d-4bab-b484-9d0f188c19b6', 'tenant_id': 'ba7789f528bf4befb68a21f4c2498c04', 'mac_address': 'fa:16:3e:8a:6b:69', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1332a475-4493-4edf-9b3e-9cabb6f0ef57', 'device_owner': 'network:router_interface', 'standard_attr_id': 343, 'fixed_ips': [{'subnet_id': '8fbe5513-cda8-4cd9-b261-e9e9b9a9609f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:22Z', 'updated_at': '2021-06-01T06:13:23Z', 'revision_number': 1, 'project_id': 'ba7789f528bf4befb68a21f4c2498c04', 'subnets': [{'id': '8fbe5513-cda8-4cd9-b261-e9e9b9a9609f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:13:25.602385 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=4ba492f1-8627-418b-b6d8-63900e8f34eb,revision_number=3']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:25.609457 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:25.671564 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.733s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:25.680459 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 9708fa96-563b-40e8-9c0f-8540e15e4126 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:25.685180 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:25.811753 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-52be5f10-f77c-4684-8228-04b4957b3f5b None None] Provisioning for port a75c6cfb-ca4a-4dc4-981a-b8362697c093 completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:13:25.854235 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-52be5f10-f77c-4684-8228-04b4957b3f5b None None] Provisioning complete for port a75c6cfb-ca4a-4dc4-981a-b8362697c093 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:25.854537 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-52be5f10-f77c-4684-8228-04b4957b3f5b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:26.089452 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] Router 1332a475-4493-4edf-9b3e-9cabb6f0ef57 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92230) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:13:26.145440 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-915838a9-1c80-408c-9d6b-370efd4b3382 req-d1c4b5a6-6e03-44f1-9473-cdf5b91636e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:26.147041 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-915838a9-1c80-408c-9d6b-370efd4b3382 req-d1c4b5a6-6e03-44f1-9473-cdf5b91636e7 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=8f1cf739e243401eb5da7ee705e856de&device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 1098 time: 0.3594482
Jun 01 06:13:26.183720 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device aef202dd-622d-40c5-bcd0-3e6b5c08efe2 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:26.297824 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-52be5f10-f77c-4684-8228-04b4957b3f5b None None] Port a75c6cfb-ca4a-4dc4-981a-b8362697c093 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:13:26.561509 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174f4d2d-b149-49d8-8def-cbb2b465b59c req-1741e0e5-e42d-4286-b48a-b194688a94c4 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:26.567843 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-174f4d2d-b149-49d8-8def-cbb2b465b59c req-1741e0e5-e42d-4286-b48a-b194688a94c4 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.8455498
Jun 01 06:13:26.580186 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:13:26.597077 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] 10.222.0.25 "PUT /v2.0/routers/1332a475-4493-4edf-9b3e-9cabb6f0ef57/add_router_interface HTTP/1.1" status: 200  len: 503 time: 5.4802883
Jun 01 06:13:26.649235 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-915838a9-1c80-408c-9d6b-370efd4b3382 req-c7a5e84a-8890-44dd-b573-ed781e27b68c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:26.651672 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-915838a9-1c80-408c-9d6b-370efd4b3382 req-c7a5e84a-8890-44dd-b573-ed781e27b68c service neutron] 10.222.0.48 "GET /v2.0/networks?id=6e45a0e5-f930-4b18-8f4f-1693815eb31a HTTP/1.1" status: 200  len: 919 time: 0.4969318
Jun 01 06:13:26.676502 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port aef202dd-622d-40c5-bcd0-3e6b5c08efe2 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:13:26.679623 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-174f4d2d-b149-49d8-8def-cbb2b465b59c req-723c3edc-9ff4-483f-ab8e-797249cb2094 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1016495
Jun 01 06:13:26.682132 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:26.690386 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:26.691060 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-582666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-744156'] for router_interface, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:26.705612 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:26.706722 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port aef202dd-622d-40c5-bcd0-3e6b5c08efe2 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:26.707101 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:26.767486 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-b9eacb56-d2a1-4422-b1fa-1fdba5b98a45 None None] Provisioning for port cd6dda6e-46d3-4412-9652-c686f5fad712 completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:13:26.810243 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] Notify callbacks [] for port, precommit_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:26.817767 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-b9eacb56-d2a1-4422-b1fa-1fdba5b98a45 None None] Provisioning complete for port cd6dda6e-46d3-4412-9652-c686f5fad712 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:26.818475 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b9eacb56-d2a1-4422-b1fa-1fdba5b98a45 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:26.912270 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] Transition to ACTIVE for port object 11fed125-e49d-4bbd-8888-eac8a4fe11e9 will not be triggered until provisioned by entity L2. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:13:26.920035 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Pushing event updated for resources: {'Port': ['ID=cd6dda6e-46d3-4412-9652-c686f5fad712,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:26.924533 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.218s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:26.929442 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:26.941928 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:27.016232 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Network 028fef0a-f05a-48d5-ba5c-b539846209ba is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:13:27.017381 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:13:27.021530 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-b9eacb56-d2a1-4422-b1fa-1fdba5b98a45 None None] Port cd6dda6e-46d3-4412-9652-c686f5fad712 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:13:27.115156 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] Attempting to bind port 11fed125-e49d-4bbd-8888-eac8a4fe11e9 on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:13:27.115827 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] Attempting to bind port 11fed125-e49d-4bbd-8888-eac8a4fe11e9 by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:13:27.116807 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] Attempting to bind port 11fed125-e49d-4bbd-8888-eac8a4fe11e9 on network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:13:27.129899 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 13, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:13:27.130403 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] Checking segment: {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92231) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:13:27.130878 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:27.131425 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] Bound using segment: {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:13:27.131963 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] Bound port: 11fed125-e49d-4bbd-8888-eac8a4fe11e9, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:13:27.132400 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:27.230702 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:27.269167 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-b9eacb56-d2a1-4422-b1fa-1fdba5b98a45 None None] Provisioning complete for port a75c6cfb-ca4a-4dc4-981a-b8362697c093 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:27.269627 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b9eacb56-d2a1-4422-b1fa-1fdba5b98a45 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:27.290120 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Router 00ab7a71-e7f7-4524-99c9-7562f23905d1 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92229) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:13:27.298060 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea2a0641-e943-4ea2-af23-879ef1dd1fbf None None] Pushing event updated for resources: {'Port': ['ID=11fed125-e49d-4bbd-8888-eac8a4fe11e9,revision_number=2']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:27.314667 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-ea2a0641-e943-4ea2-af23-879ef1dd1fbf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.373s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:27.359436 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port aef202dd-622d-40c5-bcd0-3e6b5c08efe2, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=aef202dd-622d-40c5-bcd0-3e6b5c08efe2,segment=NetworkSegment(e9a368be-e119-4f56-bdcc-b9d10543e0d8),segment_id=e9a368be-e119-4f56-bdcc-b9d10543e0d8)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:13:27.376994 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:27.395081 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:27.516803 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] For port 11fed125-e49d-4bbd-8888-eac8a4fe11e9, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92231) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:13:27.523128 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-b9eacb56-d2a1-4422-b1fa-1fdba5b98a45 None None] Port a75c6cfb-ca4a-4dc4-981a-b8362697c093 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:13:27.549128 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=aef202dd-622d-40c5-bcd0-3e6b5c08efe2,revision_number=3']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:27.561324 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] For port 11fed125-e49d-4bbd-8888-eac8a4fe11e9, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=11fed125-e49d-4bbd-8888-eac8a4fe11e9,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92231) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:13:27.567541 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:27.575019 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:27.579819 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92229) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:13:27.583811 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-0f758f4d-8456-4249-be2d-aa8b090a0a44 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:27.604270 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] 10.222.0.25 "PUT /v2.0/routers/00ab7a71-e7f7-4524-99c9-7562f23905d1/add_router_interface HTTP/1.1" status: 200  len: 503 time: 5.2559993
Jun 01 06:13:27.661484 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34330) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:27.668166 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-346298564', 'description': 'tempest-secgroup-smoke-346298564 description', 'project_id': '60be617f683c42a081ab3f50c3bdf8f1'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:27.684686 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:27.696704 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Usage tracker for resource:security_group and tenant:60be617f683c42a081ab3f50c3bdf8f1 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:27.708833 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:27.727050 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 962c60b2-2fe3-4cde-a7fb-73010b6c5779 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:27.748131 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:27.770842 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-915838a9-1c80-408c-9d6b-370efd4b3382 req-225888f8-78a4-4dfb-a27d-18d6471d51c1 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5f320f89-ada2-472d-b9ac-0676b4c4b578 HTTP/1.1" status: 200  len: 217 time: 0.1345985
Jun 01 06:13:27.775611 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:27.822011 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:27.828386 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Usage tracker for resource:security_group_rule and tenant:60be617f683c42a081ab3f50c3bdf8f1 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:27.832488 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:27.841408 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:27.895716 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-51ceb27b-3fa0-494e-9a0d-f268100ae681 None None] Provisioning complete for port cd6dda6e-46d3-4412-9652-c686f5fad712 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:27.896354 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-51ceb27b-3fa0-494e-9a0d-f268100ae681 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:27.938918 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:27.945509 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:27.972541 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-7a23ecde-11b5-49d1-b235-b5978f496eb9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:27.983479 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:27.987606 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1792 time: 0.3223388
Jun 01 06:13:27.987885 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34340) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:27.999566 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-6c57ca6b-1158-402e-89bf-a0d1445a7f66 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Request body: {'security_group_rule': {'security_group_id': '659a9ce0-c758-4944-9feb-468439eee519', 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:28.006811 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6931170b-80fc-46f8-b387-406c6a570df1 req-df873976-1f83-4df1-9480-b5300e6a22ce tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:28.008601 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6931170b-80fc-46f8-b387-406c6a570df1 req-df873976-1f83-4df1-9480-b5300e6a22ce tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1071992
Jun 01 06:13:28.015484 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-51ceb27b-3fa0-494e-9a0d-f268100ae681 None None] Port cd6dda6e-46d3-4412-9652-c686f5fad712 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:13:28.032588 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-6c57ca6b-1158-402e-89bf-a0d1445a7f66 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:28.034212 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea2a0641-e943-4ea2-af23-879ef1dd1fbf None None] Pushing event updated for resources: {'Port': ['ID=11fed125-e49d-4bbd-8888-eac8a4fe11e9,revision_number=3']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:28.039876 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-6c57ca6b-1158-402e-89bf-a0d1445a7f66 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Usage tracker for resource:security_group_rule and tenant:60be617f683c42a081ab3f50c3bdf8f1 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:28.044040 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Pushing event updated for resources: {'SecurityGroup': ['ID=659a9ce0-c758-4944-9feb-468439eee519,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:28.044983 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea2a0641-e943-4ea2-af23-879ef1dd1fbf None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.045337 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea2a0641-e943-4ea2-af23-879ef1dd1fbf None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.045861 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea2a0641-e943-4ea2-af23-879ef1dd1fbf None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.046341 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea2a0641-e943-4ea2-af23-879ef1dd1fbf None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.046813 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea2a0641-e943-4ea2-af23-879ef1dd1fbf None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.047288 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea2a0641-e943-4ea2-af23-879ef1dd1fbf None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.047879 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea2a0641-e943-4ea2-af23-879ef1dd1fbf None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.048354 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea2a0641-e943-4ea2-af23-879ef1dd1fbf None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.048821 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea2a0641-e943-4ea2-af23-879ef1dd1fbf None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.049309 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea2a0641-e943-4ea2-af23-879ef1dd1fbf None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.049929 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea2a0641-e943-4ea2-af23-879ef1dd1fbf None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.050647 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea2a0641-e943-4ea2-af23-879ef1dd1fbf None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.054457 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] Routers {'00ab7a71-e7f7-4524-99c9-7562f23905d1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:13:28.055585 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b1820880>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:13:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['00ab7a71-e7f7-4524-99c9-7562f23905d1'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:28.058938 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-6c57ca6b-1158-402e-89bf-a0d1445a7f66 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:28.062994 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.063355 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.063701 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.064073 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.064410 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.064741 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.065070 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.065398 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.065725 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.066052 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.066376 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.066832 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:13:28.070746 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:28.076423 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-6c57ca6b-1158-402e-89bf-a0d1445a7f66 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:28.088934 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6931170b-80fc-46f8-b387-406c6a570df1 req-9185e404-c0aa-424e-84c2-b5b511c2308f tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0720274
Jun 01 06:13:28.103160 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-6c57ca6b-1158-402e-89bf-a0d1445a7f66 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.122734 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-ea2a0641-e943-4ea2-af23-879ef1dd1fbf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.539s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:28.162248 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port 962c60b2-2fe3-4cde-a7fb-73010b6c5779 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:13:28.190869 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-6c57ca6b-1158-402e-89bf-a0d1445a7f66 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.199388 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-6c57ca6b-1158-402e-89bf-a0d1445a7f66 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.201457 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:28.224009 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c57ca6b-1158-402e-89bf-a0d1445a7f66 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c548f302-25ee-4c24-a88c-ba71eda88e5f,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:28.229535 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-6c57ca6b-1158-402e-89bf-a0d1445a7f66 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:28.238660 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-6c57ca6b-1158-402e-89bf-a0d1445a7f66 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.240025 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-6c57ca6b-1158-402e-89bf-a0d1445a7f66 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.2511678
Jun 01 06:13:28.242934 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34350) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:28.244567 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 962c60b2-2fe3-4cde-a7fb-73010b6c5779 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:28.245004 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.249154 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-507be55f-3405-4757-bb8c-c38c8ee8b237 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Request body: {'security_group_rule': {'security_group_id': '659a9ce0-c758-4944-9feb-468439eee519', 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:28.255242 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-507be55f-3405-4757-bb8c-c38c8ee8b237 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:28.260447 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-507be55f-3405-4757-bb8c-c38c8ee8b237 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Usage tracker for resource:security_group_rule and tenant:60be617f683c42a081ab3f50c3bdf8f1 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:28.263649 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-507be55f-3405-4757-bb8c-c38c8ee8b237 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:28.270045 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-507be55f-3405-4757-bb8c-c38c8ee8b237 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:28.293379 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-507be55f-3405-4757-bb8c-c38c8ee8b237 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.327854 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] Set router 00ab7a71-e7f7-4524-99c9-7562f23905d1 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:13:28.393817 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-507be55f-3405-4757-bb8c-c38c8ee8b237 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.398703 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-507be55f-3405-4757-bb8c-c38c8ee8b237 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.402062 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:28.422596 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 34358) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:28.429413 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1279291552-network', 'tenant_id': '59b1a5cf77d140469fb6596ad2fdef03'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:28.435304 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-507be55f-3405-4757-bb8c-c38c8ee8b237 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=98604ccf-f60d-4173-9bf0-26f4a998fe47,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:28.436801 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:28.437830 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-507be55f-3405-4757-bb8c-c38c8ee8b237 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:28.441874 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Usage tracker for resource:network and tenant:59b1a5cf77d140469fb6596ad2fdef03 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:28.445122 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:28.446101 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-507be55f-3405-4757-bb8c-c38c8ee8b237 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.450212 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-507be55f-3405-4757-bb8c-c38c8ee8b237 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.2030845
Jun 01 06:13:28.450506 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34362) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:28.452600 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:28.457608 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-a8b6c945-a7bf-451f-966f-90e7273095d0 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Request body: {'security_group_rule': {'security_group_id': '659a9ce0-c758-4944-9feb-468439eee519', 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:28.465974 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-a8b6c945-a7bf-451f-966f-90e7273095d0 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:28.468019 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Made reservation on behalf of 59b1a5cf77d140469fb6596ad2fdef03 for: {'network': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:13:28.470835 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-a8b6c945-a7bf-451f-966f-90e7273095d0 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Usage tracker for resource:security_group_rule and tenant:60be617f683c42a081ab3f50c3bdf8f1 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:28.471924 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-8110114'] for network, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.474810 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-a8b6c945-a7bf-451f-966f-90e7273095d0 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:28.481839 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-a8b6c945-a7bf-451f-966f-90e7273095d0 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:28.491421 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.502972 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a8b6c945-a7bf-451f-966f-90e7273095d0 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.512505 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:28.518155 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Usage tracker for resource:security_group_rule and tenant:59b1a5cf77d140469fb6596ad2fdef03 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:28.523694 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:28.536419 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:28.595207 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a8b6c945-a7bf-451f-966f-90e7273095d0 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.599022 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a8b6c945-a7bf-451f-966f-90e7273095d0 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.610997 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-a742ab03-5602-4901-b626-0ba8460b291b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:28.637127 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.638562 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8b6c945-a7bf-451f-966f-90e7273095d0 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=08af1b8e-4dec-4e40-9392-2e5998c3e023,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:28.648659 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-a8b6c945-a7bf-451f-966f-90e7273095d0 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:28.657672 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.662887 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.664287 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a8b6c945-a7bf-451f-966f-90e7273095d0 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.668381 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-a8b6c945-a7bf-451f-966f-90e7273095d0 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.2142889
Jun 01 06:13:28.668612 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:28.669332 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34366) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:28.675852 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-2260ee17-0b2c-4650-90fb-a99586cfb14c tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Request body: {'security_group_rule': {'security_group_id': '659a9ce0-c758-4944-9feb-468439eee519', 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:28.683700 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-2260ee17-0b2c-4650-90fb-a99586cfb14c tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:28.688441 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-2260ee17-0b2c-4650-90fb-a99586cfb14c tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Usage tracker for resource:security_group_rule and tenant:60be617f683c42a081ab3f50c3bdf8f1 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:28.689588 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port 962c60b2-2fe3-4cde-a7fb-73010b6c5779, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=962c60b2-2fe3-4cde-a7fb-73010b6c5779,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:13:28.692349 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-2260ee17-0b2c-4650-90fb-a99586cfb14c tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:28.697062 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] vlan segment allocate from pool success with {'vlan_id': 220, 'physical_network': 'physnet1'}  {{(pid=92229) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 06:13:28.697361 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.698472 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 4ba492f1-8627-418b-b6d8-63900e8f34eb up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:28.699939 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-2260ee17-0b2c-4650-90fb-a99586cfb14c tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:28.711421 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e1ba825d-93c9-4f29-ba44-2b52e5063c06,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:28.719162 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.719162 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.db.segments_db [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Added segment 82caaa19-2534-4a80-96d3-c3f641675978 of type vlan for network 5e198e3e-b0b7-4f03-a4b5-1307a1cfe333
Jun 01 06:13:28.729874 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:28.733091 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2260ee17-0b2c-4650-90fb-a99586cfb14c tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.757634 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-7007a856-a4dc-436c-8864-62f358f28431 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:28.785884 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8788496565589'] for network, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.822143 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] Sync routers for ids ['1332a475-4493-4edf-9b3e-9cabb6f0ef57'] in dv-cinder-793885-1-iscsi {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:13:28.836848 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2260ee17-0b2c-4650-90fb-a99586cfb14c tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.839544 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104'] for network, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.840214 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] Routers {'1332a475-4493-4edf-9b3e-9cabb6f0ef57'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:13:28.840971 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2906850>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:13:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['1332a475-4493-4edf-9b3e-9cabb6f0ef57'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:28.842729 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:28.844468 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.848054 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2260ee17-0b2c-4650-90fb-a99586cfb14c tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.851124 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:28.854748 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-f88635c8-6a0d-4472-947d-eeb86065f95a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:28.918553 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2260ee17-0b2c-4650-90fb-a99586cfb14c tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=19c697f3-3152-4e76-b261-7407fc605386,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:28.934787 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=962c60b2-2fe3-4cde-a7fb-73010b6c5779,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:28.935686 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-2260ee17-0b2c-4650-90fb-a99586cfb14c tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:28.938676 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 4ba492f1-8627-418b-b6d8-63900e8f34eb triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:28.939054 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.945307 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2260ee17-0b2c-4650-90fb-a99586cfb14c tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:28.947218 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-2260ee17-0b2c-4650-90fb-a99586cfb14c tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.2768979
Jun 01 06:13:28.950479 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34374) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:28.956186 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-3c1afa11-3b36-432c-9e51-2351c399046b tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Request body: {'security_group_rule': {'security_group_id': '659a9ce0-c758-4944-9feb-468439eee519', 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:28.964982 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:28.972189 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-3c1afa11-3b36-432c-9e51-2351c399046b tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:28.982231 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-3c1afa11-3b36-432c-9e51-2351c399046b tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Usage tracker for resource:security_group_rule and tenant:60be617f683c42a081ab3f50c3bdf8f1 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:28.988221 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-3c1afa11-3b36-432c-9e51-2351c399046b tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:29.002891 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-3c1afa11-3b36-432c-9e51-2351c399046b tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:29.019764 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Pushing event updated for resources: {'Network': ['ID=5e198e3e-b0b7-4f03-a4b5-1307a1cfe333,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:29.024710 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:29.029885 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34378) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:29.030254 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 885 time: 0.6055861
Jun 01 06:13:29.035760 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-921b18b6-42e2-4a4c-b352-c3fa15ac613c admin admin] Request body: {'subnet': {'network_id': '5e198e3e-b0b7-4f03-a4b5-1307a1cfe333', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1279291552-subnet', 'tenant_id': '59b1a5cf77d140469fb6596ad2fdef03', 'ip_version': 4}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:29.038898 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b1820880>, [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': 'cd6dda6e-46d3-4412-9652-c686f5fad712', 'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'mac_address': 'fa:16:3e:aa:f2:09', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:24Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 2, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'subnets': [{'id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:29.040885 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.db.securitygroups_db [None req-3c1afa11-3b36-432c-9e51-2351c399046b tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Project 60be617f683c42a081ab3f50c3bdf8f1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 06:13:29.044773 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-921b18b6-42e2-4a4c-b352-c3fa15ac613c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:29.044942 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Network 5e198e3e-b0b7-4f03-a4b5-1307a1cfe333 details requested by agent ovs-agent-dv-cinder-793885-1-iscsi with host dv-cinder-793885-1-iscsi {{(pid=92231) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 06:13:29.050879 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-921b18b6-42e2-4a4c-b352-c3fa15ac613c admin admin] Usage tracker for resource:subnet and tenant:59b1a5cf77d140469fb6596ad2fdef03 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:29.053671 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3c1afa11-3b36-432c-9e51-2351c399046b tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:29.061337 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-921b18b6-42e2-4a4c-b352-c3fa15ac613c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:29.071840 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-921b18b6-42e2-4a4c-b352-c3fa15ac613c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:29.100886 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-921b18b6-42e2-4a4c-b352-c3fa15ac613c admin admin] Made reservation on behalf of 59b1a5cf77d140469fb6596ad2fdef03 for: {'subnet': 1} {{(pid=92230) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:13:29.102024 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6122eb7-2684-4c4c-8887-f3a03f46cacb None None] The sync data for ids ['00ab7a71-e7f7-4524-99c9-7562f23905d1'] in dv-cinder-793885-1-iscsi is: [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': 'cd6dda6e-46d3-4412-9652-c686f5fad712', 'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'mac_address': 'fa:16:3e:aa:f2:09', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:24Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 2, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'subnets': [{'id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:13:29.103627 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-921b18b6-42e2-4a4c-b352-c3fa15ac613c admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1981512'] for subnet, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:29.130327 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] Set router 1332a475-4493-4edf-9b3e-9cabb6f0ef57 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:13:29.255492 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3c1afa11-3b36-432c-9e51-2351c399046b tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:29.262506 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3c1afa11-3b36-432c-9e51-2351c399046b tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:29.267979 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:29.297881 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c1afa11-3b36-432c-9e51-2351c399046b tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=898fdc1f-1c82-4ba6-a41f-45c1a248b95f,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:29.304283 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-3c1afa11-3b36-432c-9e51-2351c399046b tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:29.319088 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3c1afa11-3b36-432c-9e51-2351c399046b tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:29.320335 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-3c1afa11-3b36-432c-9e51-2351c399046b tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.3686349
Jun 01 06:13:29.323935 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 34384) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:29.338615 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-12e6d800-6dbb-479f-94ee-a5bc52959925 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Request body: {'security_group_rule': {'security_group_id': '659a9ce0-c758-4944-9feb-468439eee519', 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:29.347935 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-12e6d800-6dbb-479f-94ee-a5bc52959925 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:29.363849 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c70c8166-731d-41e0-adf9-ee75738adfaf req-58384a4d-5270-424b-90ee-f99647cd40af tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:29.365500 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c70c8166-731d-41e0-adf9-ee75738adfaf req-58384a4d-5270-424b-90ee-f99647cd40af tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1194403
Jun 01 06:13:29.366717 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-12e6d800-6dbb-479f-94ee-a5bc52959925 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Usage tracker for resource:security_group_rule and tenant:60be617f683c42a081ab3f50c3bdf8f1 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:29.371067 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-12e6d800-6dbb-479f-94ee-a5bc52959925 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:29.378950 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-12e6d800-6dbb-479f-94ee-a5bc52959925 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:29.435573 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.db.securitygroups_db [None req-12e6d800-6dbb-479f-94ee-a5bc52959925 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Project 60be617f683c42a081ab3f50c3bdf8f1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 06:13:29.462850 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-12e6d800-6dbb-479f-94ee-a5bc52959925 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:29.558587 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c70c8166-731d-41e0-adf9-ee75738adfaf req-1cbe9bf1-6062-4d50-aefe-91f96cd36b8e tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1671121
Jun 01 06:13:29.608178 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 962c60b2-2fe3-4cde-a7fb-73010b6c5779 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:29.715607 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-12e6d800-6dbb-479f-94ee-a5bc52959925 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:29.726927 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-915838a9-1c80-408c-9d6b-370efd4b3382 req-0a966f80-916e-4448-9bb2-d9786b25150a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:29.733085 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-915838a9-1c80-408c-9d6b-370efd4b3382 req-0a966f80-916e-4448-9bb2-d9786b25150a service neutron] 10.222.0.48 "GET /v2.0/subnets?id=84c296fc-69c0-46e2-b1ed-e3edf435b759 HTTP/1.1" status: 200  len: 858 time: 0.1731787
Jun 01 06:13:29.733994 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-12e6d800-6dbb-479f-94ee-a5bc52959925 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:29.737127 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2906850>, [{'id': '1332a475-4493-4edf-9b3e-9cabb6f0ef57', 'name': 'tempest-TestShelveInstance-2060600636-router', 'tenant_id': 'ba7789f528bf4befb68a21f4c2498c04', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.18'}], 'enable_snat': True}, 'gw_port_id': '962c60b2-2fe3-4cde-a7fb-73010b6c5779', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:16Z', 'updated_at': '2021-06-01T06:13:23Z', 'revision_number': 4, 'project_id': 'ba7789f528bf4befb68a21f4c2498c04', 'gw_port': {'id': '962c60b2-2fe3-4cde-a7fb-73010b6c5779', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:f2:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1332a475-4493-4edf-9b3e-9cabb6f0ef57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 340, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.18', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': 'a75c6cfb-ca4a-4dc4-981a-b8362697c093', 'name': '', 'network_id': '95697b5d-7f1d-4bab-b484-9d0f188c19b6', 'tenant_id': 'ba7789f528bf4befb68a21f4c2498c04', 'mac_address': 'fa:16:3e:8a:6b:69', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1332a475-4493-4edf-9b3e-9cabb6f0ef57', 'device_owner': 'network:router_interface', 'standard_attr_id': 343, 'fixed_ips': [{'subnet_id': '8fbe5513-cda8-4cd9-b261-e9e9b9a9609f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:22Z', 'updated_at': '2021-06-01T06:13:24Z', 'revision_number': 2, 'project_id': 'ba7789f528bf4befb68a21f4c2498c04', 'subnets': [{'id': '8fbe5513-cda8-4cd9-b261-e9e9b9a9609f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:29.744440 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] Checking router: 1332a475-4493-4edf-9b3e-9cabb6f0ef57 for host: dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:13:29.745749 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] Updating router 1332a475-4493-4edf-9b3e-9cabb6f0ef57 port a75c6cfb-ca4a-4dc4-981a-b8362697c093 binding host dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 06:13:29.753250 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 962c60b2-2fe3-4cde-a7fb-73010b6c5779 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:29.756025 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:29.833667 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:29.848125 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:29.854712 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-921b18b6-42e2-4a4c-b352-c3fa15ac613c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2445565', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1981534'] for subnet, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:29.859055 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:29.865453 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-915838a9-1c80-408c-9d6b-370efd4b3382 req-8f11a933-a73b-453f-89de-a24e61b3581f service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=6e45a0e5-f930-4b18-8f4f-1693815eb31a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0916457
Jun 01 06:13:29.903122 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device aef202dd-622d-40c5-bcd0-3e6b5c08efe2 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:29.916689 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12e6d800-6dbb-479f-94ee-a5bc52959925 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c086748d-b185-47af-8816-be4f19b2a056,revision_number=0']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:29.941879 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-12e6d800-6dbb-479f-94ee-a5bc52959925 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:29.942650 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-12e6d800-6dbb-479f-94ee-a5bc52959925 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:29.943876 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-12e6d800-6dbb-479f-94ee-a5bc52959925 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.6187558
Jun 01 06:13:30.004258 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port aef202dd-622d-40c5-bcd0-3e6b5c08efe2 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:30.005110 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:30.054990 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-921b18b6-42e2-4a4c-b352-c3fa15ac613c admin admin] Pushing event updated for resources: {'Subnet': ['ID=8301243f-f3d8-4aba-9f42-177e554580b1,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:30.066519 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-921b18b6-42e2-4a4c-b352-c3fa15ac613c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:30.069017 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-921b18b6-42e2-4a4c-b352-c3fa15ac613c admin admin] Checking segment: {'id': '82caaa19-2534-4a80-96d3-c3f641675978', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 220, 'network_id': '5e198e3e-b0b7-4f03-a4b5-1307a1cfe333'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92230) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:13:30.072247 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-921b18b6-42e2-4a4c-b352-c3fa15ac613c admin admin] Network hostable DHCP agents. Network: 5e198e3e-b0b7-4f03-a4b5-1307a1cfe333, hostable agents: ['648832f0-f26e-4e29-ac0d-d97e4a75c6c4'], hosted agents: [] {{(pid=92230) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 06:13:30.133995 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-921b18b6-42e2-4a4c-b352-c3fa15ac613c admin admin] Network 5e198e3e-b0b7-4f03-a4b5-1307a1cfe333 is scheduled to be hosted by DHCP agent 648832f0-f26e-4e29-ac0d-d97e4a75c6c4 with binding_index 1 {{(pid=92230) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 06:13:30.155432 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-921b18b6-42e2-4a4c-b352-c3fa15ac613c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793885-1-iscsi, 5e198e3e-b0b7-4f03-a4b5-1307a1cfe333) {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:13:30.181440 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-921b18b6-42e2-4a4c-b352-c3fa15ac613c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:30.182038 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-921b18b6-42e2-4a4c-b352-c3fa15ac613c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:30.189282 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-915838a9-1c80-408c-9d6b-370efd4b3382 req-e2ad9e7e-6b74-4bbe-8b3f-3128084c669a service neutron] 10.222.0.48 "GET /v2.0/networks/6e45a0e5-f930-4b18-8f4f-1693815eb31a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3157783
Jun 01 06:13:30.209740 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-921b18b6-42e2-4a4c-b352-c3fa15ac613c admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 848 time: 1.1786511
Jun 01 06:13:30.212829 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34396) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:30.218878 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1279291552-router', 'tenant_id': '59b1a5cf77d140469fb6596ad2fdef03', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:30.236074 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ddc1ed02-b446-4f09-9458-4af71fa59a57 None None] Network 5e198e3e-b0b7-4f03-a4b5-1307a1cfe333 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:13:30.240802 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:30.248807 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Usage tracker for resource:router and tenant:59b1a5cf77d140469fb6596ad2fdef03 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:30.258271 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:30.269230 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:30.302933 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-748217', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-677'] for router, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:30.304172 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-749241', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-745574', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-726667', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-686'] for router, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:30.325884 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:30.625150 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-915838a9-1c80-408c-9d6b-370efd4b3382 req-3a507838-f51e-4f42-bce0-5279757557b6 service neutron] 10.222.0.48 "GET /v2.0/networks/6e45a0e5-f930-4b18-8f4f-1693815eb31a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4132512
Jun 01 06:13:30.656875 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] Notify callbacks [] for port, precommit_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:30.723749 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.provisioning_blocks [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] Transition to ACTIVE for port object a75c6cfb-ca4a-4dc4-981a-b8362697c093 will not be triggered until provisioned by entity L2. {{(pid=92232) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:13:30.745045 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:30.757532 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.002s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:30.863539 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp5012ce77-b332-5f05-8982-a48a8fc8d50e-5e198e3e-b0b7-4f03-a4b5-1307a1cfe333', 'network_id': '5e198e3e-b0b7-4f03-a4b5-1307a1cfe333', 'tenant_id': '59b1a5cf77d140469fb6596ad2fdef03', 'fixed_ips': [{'subnet_id': '8301243f-f3d8-4aba-9f42-177e554580b1'}]}} from dv-cinder-793885-1-iscsi. {{(pid=92231) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 06:13:30.870939 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:31.117071 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faf1fdda-1b7d-4a7c-9b8e-1012b38eff4d req-425b9f5f-7881-4131-af27-24b1855f24b7 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:31.120098 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c639d7f2-7c5d-4fdf-a4c2-6c38a595b20d None None] Pushing event updated for resources: {'Port': ['ID=a75c6cfb-ca4a-4dc4-981a-b8362697c093,revision_number=3']} {{(pid=92232) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:31.124626 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-c639d7f2-7c5d-4fdf-a4c2-6c38a595b20d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.367s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:31.125608 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-faf1fdda-1b7d-4a7c-9b8e-1012b38eff4d req-425b9f5f-7881-4131-af27-24b1855f24b7 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.2467916
Jun 01 06:13:31.155248 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] Attempting to bind port a75c6cfb-ca4a-4dc4-981a-b8362697c093 on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:13:31.169743 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] Attempting to bind port a75c6cfb-ca4a-4dc4-981a-b8362697c093 by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': '3df30a41-b01e-4383-92a4-8350393bd930', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 212, 'network_id': '95697b5d-7f1d-4bab-b484-9d0f188c19b6'}] {{(pid=92232) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:13:31.170394 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] Attempting to bind port a75c6cfb-ca4a-4dc4-981a-b8362697c093 on network 95697b5d-7f1d-4bab-b484-9d0f188c19b6 {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:13:31.190226 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 13, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:13:31.190931 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] Checking segment: {'id': '3df30a41-b01e-4383-92a4-8350393bd930', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 212, 'network_id': '95697b5d-7f1d-4bab-b484-9d0f188c19b6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92232) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:13:31.191624 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:31.194983 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-745539', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-748171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-728'] for router, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:31.196852 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] Bound using segment: {'id': '3df30a41-b01e-4383-92a4-8350393bd930', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 212, 'network_id': '95697b5d-7f1d-4bab-b484-9d0f188c19b6'} {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:13:31.209330 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] Bound port: a75c6cfb-ca4a-4dc4-981a-b8362697c093, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3df30a41-b01e-4383-92a4-8350393bd930', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 212, 'network_id': '95697b5d-7f1d-4bab-b484-9d0f188c19b6'}}] {{(pid=92232) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:13:31.210321 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:31.278943 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.db_base_plugin_common [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Allocated IP 172.20.0.2 (5e198e3e-b0b7-4f03-a4b5-1307a1cfe333/8301243f-f3d8-4aba-9f42-177e554580b1/8c540a0d-e1ed-4b75-9238-d7951633d4bc) {{(pid=92231) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:13:31.293265 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-faf1fdda-1b7d-4a7c-9b8e-1012b38eff4d req-6134303a-4c18-4320-95c0-e4ead8c343a9 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1663728
Jun 01 06:13:31.443730 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.db [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] For port a75c6cfb-ca4a-4dc4-981a-b8362697c093, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92232) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:13:31.452999 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.db [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] For port a75c6cfb-ca4a-4dc4-981a-b8362697c093, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=a75c6cfb-ca4a-4dc4-981a-b8362697c093,segment=NetworkSegment(3df30a41-b01e-4383-92a4-8350393bd930),segment_id=3df30a41-b01e-4383-92a4-8350393bd930)] {{(pid=92232) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:13:31.465911 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:31.487199 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-35596c19-72f7-4ba1-9bdc-3b0a399e5fcb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:31.735225 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] Routers {'1332a475-4493-4edf-9b3e-9cabb6f0ef57'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:13:31.735917 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2906850>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:13:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['1332a475-4493-4edf-9b3e-9cabb6f0ef57'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:31.930440 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Notify callbacks [] for port, precommit_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:31.944342 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Transition to ACTIVE for port object 8c540a0d-e1ed-4b75-9238-d7951633d4bc will not be triggered until provisioned by entity L2. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:13:31.982439 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Transition to ACTIVE for port object 8c540a0d-e1ed-4b75-9238-d7951633d4bc will not be triggered until provisioned by entity DHCP. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:13:32.000855 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 11fed125-e49d-4bbd-8888-eac8a4fe11e9 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:32.076809 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:32.093518 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:32.140932 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:32.153604 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c639d7f2-7c5d-4fdf-a4c2-6c38a595b20d None None] Pushing event updated for resources: {'Port': ['ID=a75c6cfb-ca4a-4dc4-981a-b8362697c093,revision_number=4']} {{(pid=92232) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:32.170348 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-c639d7f2-7c5d-4fdf-a4c2-6c38a595b20d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.683s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:32.204922 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:32.262382 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] Set router 1332a475-4493-4edf-9b3e-9cabb6f0ef57 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:13:32.303024 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Network 5e198e3e-b0b7-4f03-a4b5-1307a1cfe333 is already hosted by enough agents. {{(pid=92231) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:13:32.308553 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.scheduler.base_scheduler [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Resources bound (agent type, host, resource id):  {{(pid=92231) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:13:32.313729 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Received port after_create {{(pid=92231) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:13:32.351480 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Pushing event updated for resources: {'Port': ['ID=8c540a0d-e1ed-4b75-9238-d7951633d4bc,revision_number=1']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:32.358139 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.265s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:32.471092 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_common [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Allocated IP 172.27.2.224 (83b812fb-2cfc-46e4-baa4-745218ea3ed2/a59d7d11-a92c-4b4f-83cf-2095ecee2b51/110f0bf5-38a0-4190-b9b1-e7dba8cb290e) {{(pid=92230) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:13:32.683511 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Notify callbacks [] for port, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:32.698990 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e131c56-d53d-47f3-a10b-fd92e74bd5a9 req-009d56f0-ba7e-4da6-9c57-57969ddf8b49 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:32.700596 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2e131c56-d53d-47f3-a10b-fd92e74bd5a9 req-009d56f0-ba7e-4da6-9c57-57969ddf8b49 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.2356994
Jun 01 06:13:32.729698 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:32.735568 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Attempting to bind port 8c540a0d-e1ed-4b75-9238-d7951633d4bc on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:13:32.735568 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Attempting to bind port 8c540a0d-e1ed-4b75-9238-d7951633d4bc by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': '82caaa19-2534-4a80-96d3-c3f641675978', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 220, 'network_id': '5e198e3e-b0b7-4f03-a4b5-1307a1cfe333'}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:13:32.736347 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Attempting to bind port 8c540a0d-e1ed-4b75-9238-d7951633d4bc on network 5e198e3e-b0b7-4f03-a4b5-1307a1cfe333 {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:13:32.738112 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:32.751680 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 13, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:13:32.751680 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Checking segment: {'id': '82caaa19-2534-4a80-96d3-c3f641675978', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 220, 'network_id': '5e198e3e-b0b7-4f03-a4b5-1307a1cfe333'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92231) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:13:32.751680 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:32.751680 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Bound using segment: {'id': '82caaa19-2534-4a80-96d3-c3f641675978', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 220, 'network_id': '5e198e3e-b0b7-4f03-a4b5-1307a1cfe333'} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:13:32.752454 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Bound port: 8c540a0d-e1ed-4b75-9238-d7951633d4bc, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '82caaa19-2534-4a80-96d3-c3f641675978', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 220, 'network_id': '5e198e3e-b0b7-4f03-a4b5-1307a1cfe333'}}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:13:32.756558 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:32.814565 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2e131c56-d53d-47f3-a10b-fd92e74bd5a9 req-f3154b4e-8dfc-4b59-bb6a-d421355b230e tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1065981
Jun 01 06:13:32.915887 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-2033a930-f571-4414-b5dc-61eac012953b None None] For port 8c540a0d-e1ed-4b75-9238-d7951633d4bc, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92231) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:13:32.918311 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-2033a930-f571-4414-b5dc-61eac012953b None None] For port 8c540a0d-e1ed-4b75-9238-d7951633d4bc, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=8c540a0d-e1ed-4b75-9238-d7951633d4bc,segment=NetworkSegment(82caaa19-2534-4a80-96d3-c3f641675978),segment_id=82caaa19-2534-4a80-96d3-c3f641675978)] {{(pid=92231) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:13:32.919207 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port 11fed125-e49d-4bbd-8888-eac8a4fe11e9 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:13:32.928084 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 11fed125-e49d-4bbd-8888-eac8a4fe11e9 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:32.928550 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:32.970151 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Pushing event updated for resources: {'Port': ['ID=110f0bf5-38a0-4190-b9b1-e7dba8cb290e,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:32.982236 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.244s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:32.986342 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:32.992755 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2906850>, [{'id': '1332a475-4493-4edf-9b3e-9cabb6f0ef57', 'name': 'tempest-TestShelveInstance-2060600636-router', 'tenant_id': 'ba7789f528bf4befb68a21f4c2498c04', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.18'}], 'enable_snat': True}, 'gw_port_id': '962c60b2-2fe3-4cde-a7fb-73010b6c5779', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:16Z', 'updated_at': '2021-06-01T06:13:23Z', 'revision_number': 4, 'project_id': 'ba7789f528bf4befb68a21f4c2498c04', 'gw_port': {'id': '962c60b2-2fe3-4cde-a7fb-73010b6c5779', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:f2:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1332a475-4493-4edf-9b3e-9cabb6f0ef57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 340, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.18', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': 'a75c6cfb-ca4a-4dc4-981a-b8362697c093', 'name': '', 'network_id': '95697b5d-7f1d-4bab-b484-9d0f188c19b6', 'tenant_id': 'ba7789f528bf4befb68a21f4c2498c04', 'mac_address': 'fa:16:3e:8a:6b:69', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1332a475-4493-4edf-9b3e-9cabb6f0ef57', 'device_owner': 'network:router_interface', 'standard_attr_id': 343, 'fixed_ips': [{'subnet_id': '8fbe5513-cda8-4cd9-b261-e9e9b9a9609f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:22Z', 'updated_at': '2021-06-01T06:13:31Z', 'revision_number': 4, 'project_id': 'ba7789f528bf4befb68a21f4c2498c04', 'subnets': [{'id': '8fbe5513-cda8-4cd9-b261-e9e9b9a9609f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:32.994032 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:33.001872 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4796efde-3fa5-437f-9e3a-1fb70a4a07c6 None None] The sync data for ids ['1332a475-4493-4edf-9b3e-9cabb6f0ef57'] in dv-cinder-793885-1-iscsi is: [{'id': '1332a475-4493-4edf-9b3e-9cabb6f0ef57', 'name': 'tempest-TestShelveInstance-2060600636-router', 'tenant_id': 'ba7789f528bf4befb68a21f4c2498c04', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.18'}], 'enable_snat': True}, 'gw_port_id': '962c60b2-2fe3-4cde-a7fb-73010b6c5779', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:16Z', 'updated_at': '2021-06-01T06:13:23Z', 'revision_number': 4, 'project_id': 'ba7789f528bf4befb68a21f4c2498c04', 'gw_port': {'id': '962c60b2-2fe3-4cde-a7fb-73010b6c5779', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:f2:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1332a475-4493-4edf-9b3e-9cabb6f0ef57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 340, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.18', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': 'a75c6cfb-ca4a-4dc4-981a-b8362697c093', 'name': '', 'network_id': '95697b5d-7f1d-4bab-b484-9d0f188c19b6', 'tenant_id': 'ba7789f528bf4befb68a21f4c2498c04', 'mac_address': 'fa:16:3e:8a:6b:69', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1332a475-4493-4edf-9b3e-9cabb6f0ef57', 'device_owner': 'network:router_interface', 'standard_attr_id': 343, 'fixed_ips': [{'subnet_id': '8fbe5513-cda8-4cd9-b261-e9e9b9a9609f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:22Z', 'updated_at': '2021-06-01T06:13:31Z', 'revision_number': 4, 'project_id': 'ba7789f528bf4befb68a21f4c2498c04', 'subnets': [{'id': '8fbe5513-cda8-4cd9-b261-e9e9b9a9609f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:13:33.020842 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:13:33.022059 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:13:33.034330 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Received port after_create {{(pid=92230) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:13:33.081683 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Pushing event updated for resources: {'Port': ['ID=8c540a0d-e1ed-4b75-9238-d7951633d4bc,revision_number=2']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:33.092082 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:33.232595 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:33.283403 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port 11fed125-e49d-4bbd-8888-eac8a4fe11e9, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=11fed125-e49d-4bbd-8888-eac8a4fe11e9,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:13:33.299996 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:33.310471 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:33.716565 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=11fed125-e49d-4bbd-8888-eac8a4fe11e9,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:33.722210 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.420s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:33.741187 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device a75c6cfb-ca4a-4dc4-981a-b8362697c093 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:33.786443 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] Sync routers for ids ['00ab7a71-e7f7-4524-99c9-7562f23905d1'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:13:33.835632 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] Routers {'00ab7a71-e7f7-4524-99c9-7562f23905d1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:13:33.836348 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b250f490>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:13:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['00ab7a71-e7f7-4524-99c9-7562f23905d1'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:34.027646 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port a75c6cfb-ca4a-4dc4-981a-b8362697c093 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:13:34.043073 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port a75c6cfb-ca4a-4dc4-981a-b8362697c093 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:34.043477 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:34.141140 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-a540cf1c-aa0d-4bbe-a899-15b413410696 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:34.143623 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] Set router 00ab7a71-e7f7-4524-99c9-7562f23905d1 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:13:34.147558 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:34.150926 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-a540cf1c-aa0d-4bbe-a899-15b413410696 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/networks?id=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 HTTP/1.1" status: 200  len: 814 time: 0.3196135
Jun 01 06:13:34.171098 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-ec91dcbf-cf6a-459d-9316-f8a63ffd5cf2 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/quotas/b02068c8f29e4f5e9b3c965d023f7e29 HTTP/1.1" status: 200  len: 375 time: 0.0190494
Jun 01 06:13:34.255445 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c18814d1-8c8c-42ed-ae21-b84981d80b55 req-b0c2e66d-8fdc-4303-9845-614986d86ee2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:34.257659 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c18814d1-8c8c-42ed-ae21-b84981d80b55 req-b0c2e66d-8fdc-4303-9845-614986d86ee2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.2544701
Jun 01 06:13:34.319170 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-68691f8b-381c-4ad1-8de0-86c5942d5a1e tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=b02068c8f29e4f5e9b3c965d023f7e29&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1460640
Jun 01 06:13:34.494269 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:34.521126 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c18814d1-8c8c-42ed-ae21-b84981d80b55 req-be681bdd-1fd0-42fd-a110-c4e88bdb3541 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2516327
Jun 01 06:13:34.624200 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-9f5dca0a-22b0-4f35-a2ca-1a6edea50efd service neutron] 10.222.0.25 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2941296
Jun 01 06:13:34.669417 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port a75c6cfb-ca4a-4dc4-981a-b8362697c093, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=a75c6cfb-ca4a-4dc4-981a-b8362697c093,segment=NetworkSegment(3df30a41-b01e-4383-92a4-8350393bd930),segment_id=3df30a41-b01e-4383-92a4-8350393bd930)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:13:34.735140 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-748208', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-745472'] for router, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:34.747847 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:34.756550 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-ea2a0641-e943-4ea2-af23-879ef1dd1fbf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:34.883612 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=a75c6cfb-ca4a-4dc4-981a-b8362697c093,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:34.888591 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:34.898905 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-f1ff6b78-9f2b-40f1-8991-ef9257be1102 service neutron] 10.222.0.25 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2627075
Jun 01 06:13:34.927343 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15928a4f-518c-4095-8adb-14d917bc2bda req-4723b6e2-e6ca-439b-8dd0-c47fd9f113a1 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:34.928916 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-15928a4f-518c-4095-8adb-14d917bc2bda req-4723b6e2-e6ca-439b-8dd0-c47fd9f113a1 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1907187
Jun 01 06:13:34.979528 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7db26de8-68d7-4d63-a027-0839153afa2b None None] Network 5e198e3e-b0b7-4f03-a4b5-1307a1cfe333 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:13:35.008493 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-15928a4f-518c-4095-8adb-14d917bc2bda req-8058a0ec-1aac-4c61-8314-d41d2a969ff2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0722868
Jun 01 06:13:35.162110 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-4bed2a28-035a-454a-bf35-b42bfe9df002 None None] Provisioning for port 8c540a0d-e1ed-4b75-9238-d7951633d4bc completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:13:35.209476 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b250f490>, [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': 'cd6dda6e-46d3-4412-9652-c686f5fad712', 'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'mac_address': 'fa:16:3e:aa:f2:09', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:24Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 2, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'subnets': [{'id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:35.218819 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Router 07f2d8c5-b60c-44e0-9523-33ce35fba7c1 is scheduled to L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 with binding_index 1 {{(pid=92230) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 06:13:35.246427 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] Checking router: 00ab7a71-e7f7-4524-99c9-7562f23905d1 for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:13:35.250149 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] Updating router 00ab7a71-e7f7-4524-99c9-7562f23905d1 port cd6dda6e-46d3-4412-9652-c686f5fad712 binding host dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 06:13:35.254215 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3e4c8e37-e954-484f-8eac-7a7265c52e81 req-1c052107-8da6-4365-a672-899e8daa2fc3 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=d96f81cf-f6ef-481f-bebb-b48820741532 HTTP/1.1" status: 200  len: 210 time: 0.0759528
Jun 01 06:13:35.363845 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:35.580945 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:13:35.592569 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] Sync routers for ids ['07f2d8c5-b60c-44e0-9523-33ce35fba7c1'] in dv-cinder-793885-1-iscsi {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:13:35.609934 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Notify callbacks [] for router, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:35.613836 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201  len: 924 time: 5.3974979
Jun 01 06:13:35.614480 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34580) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:35.621868 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] Routers {'07f2d8c5-b60c-44e0-9523-33ce35fba7c1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:13:35.622489 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b26fa9a0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:13:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['07f2d8c5-b60c-44e0-9523-33ce35fba7c1'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:35.770007 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 11fed125-e49d-4bbd-8888-eac8a4fe11e9 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:35.863328 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af642429-77f9-4b3a-a93e-8b71b28536bd req-7b9787f9-95e2-44eb-99f0-ef347c77cf36 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:35.871867 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-af642429-77f9-4b3a-a93e-8b71b28536bd req-7b9787f9-95e2-44eb-99f0-ef347c77cf36 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.1443460
Jun 01 06:13:35.959501 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-af642429-77f9-4b3a-a93e-8b71b28536bd req-92fb9bed-8c04-4a2c-8fc5-235d1cad3d7c tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0853016
Jun 01 06:13:36.057168 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 11fed125-e49d-4bbd-8888-eac8a4fe11e9 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:36.057705 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:36.223866 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] Set router 07f2d8c5-b60c-44e0-9523-33ce35fba7c1 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:13:36.260672 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 34594) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:36.405871 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device a75c6cfb-ca4a-4dc4-981a-b8362697c093 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:36.605041 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a73a7b9e-0a98-46a6-90b4-2992236624a3 req-9d03ad48-9e69-4531-a304-474be7b2b63b tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=d96f81cf-f6ef-481f-bebb-b48820741532 HTTP/1.1" status: 200  len: 210 time: 0.0818429
Jun 01 06:13:36.663521 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-a1c401bc-3b93-46fc-8493-029bcf665228 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:36.670968 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port a75c6cfb-ca4a-4dc4-981a-b8362697c093 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:36.671348 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:36.690458 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-a1c401bc-3b93-46fc-8493-029bcf665228 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:36.694453 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-a1c401bc-3b93-46fc-8493-029bcf665228 admin admin] Usage tracker for resource:security_group_rule and tenant:33071ace78314935bf74861dc2d87842 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:36.699284 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-a1c401bc-3b93-46fc-8493-029bcf665228 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:36.705713 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-a1c401bc-3b93-46fc-8493-029bcf665228 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:36.789897 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-250248dc-565e-4f09-ab4c-0b7c0b84b139 req-280e06dc-fbc7-4eb3-ad3b-eb6f186c9cf6 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:36.800159 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-250248dc-565e-4f09-ab4c-0b7c0b84b139 req-280e06dc-fbc7-4eb3-ad3b-eb6f186c9cf6 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.4300175
Jun 01 06:13:36.815470 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] Notify callbacks [] for port, precommit_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:36.834480 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b26fa9a0>, [{'id': '07f2d8c5-b60c-44e0-9523-33ce35fba7c1', 'name': 'tempest-TestVolumeBootPattern-1279291552-router', 'tenant_id': '59b1a5cf77d140469fb6596ad2fdef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.224'}], 'enable_snat': True}, 'gw_port_id': '110f0bf5-38a0-4190-b9b1-e7dba8cb290e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:30Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 3, 'project_id': '59b1a5cf77d140469fb6596ad2fdef03', 'gw_port': {'id': '110f0bf5-38a0-4190-b9b1-e7dba8cb290e', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:36:85', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '07f2d8c5-b60c-44e0-9523-33ce35fba7c1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 364, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:32Z', 'updated_at': '2021-06-01T06:13:32Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:36.843923 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] Checking router: 07f2d8c5-b60c-44e0-9523-33ce35fba7c1 for host: dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:13:36.844581 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] Updating router 07f2d8c5-b60c-44e0-9523-33ce35fba7c1 port 110f0bf5-38a0-4190-b9b1-e7dba8cb290e binding host dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 06:13:36.864769 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] Transition to ACTIVE for port object cd6dda6e-46d3-4412-9652-c686f5fad712 will not be triggered until provisioned by entity L2. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:13:36.911043 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 8c540a0d-e1ed-4b75-9238-d7951633d4bc up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:36.916027 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-250248dc-565e-4f09-ab4c-0b7c0b84b139 req-2ff6f065-d7d8-436e-9adb-f1bc3968ca2a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1141624
Jun 01 06:13:36.916824 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:36.937941 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:36.944640 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-a1c401bc-3b93-46fc-8493-029bcf665228 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:36.947015 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:36.952294 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-a1c401bc-3b93-46fc-8493-029bcf665228 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:37.047624 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-864e2c5b-05ca-4c11-b0ae-408bfeb39c46 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:37.205617 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b8214dc-92b4-4856-a39e-d61da4083fe8 None None] Pushing event updated for resources: {'Port': ['ID=cd6dda6e-46d3-4412-9652-c686f5fad712,revision_number=3']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:37.214719 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-8b8214dc-92b4-4856-a39e-d61da4083fe8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.265s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:37.346159 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port 8c540a0d-e1ed-4b75-9238-d7951633d4bc completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:13:37.354494 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 8c540a0d-e1ed-4b75-9238-d7951633d4bc triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:37.354842 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:37.393432 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-a1c401bc-3b93-46fc-8493-029bcf665228 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=33071ace78314935bf74861dc2d87842&name=default HTTP/1.1" status: 200  len: 2979 time: 1.1311352
Jun 01 06:13:37.396204 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34608) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:37.414103 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] Attempting to bind port cd6dda6e-46d3-4412-9652-c686f5fad712 on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:13:37.414487 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] Attempting to bind port cd6dda6e-46d3-4412-9652-c686f5fad712 by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': 'e9a368be-e119-4f56-bdcc-b9d10543e0d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 209, 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba'}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:13:37.415478 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] Attempting to bind port cd6dda6e-46d3-4412-9652-c686f5fad712 on network 028fef0a-f05a-48d5-ba5c-b539846209ba {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:13:37.483490 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 13, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:13:37.484467 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] Checking segment: {'id': 'e9a368be-e119-4f56-bdcc-b9d10543e0d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 209, 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92231) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:13:37.484467 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:37.484855 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] Bound using segment: {'id': 'e9a368be-e119-4f56-bdcc-b9d10543e0d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 209, 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba'} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:13:37.485348 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] Bound port: cd6dda6e-46d3-4412-9652-c686f5fad712, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e9a368be-e119-4f56-bdcc-b9d10543e0d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 209, 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba'}}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:13:37.485722 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:37.540661 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:37.605208 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] Notify callbacks [] for port, precommit_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:37.624257 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.provisioning_blocks [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] Transition to ACTIVE for port object 110f0bf5-38a0-4190-b9b1-e7dba8cb290e will not be triggered until provisioned by entity L2. {{(pid=92232) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:13:37.636725 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:37.642718 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1c401bc-3b93-46fc-8493-029bcf665228 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=589889b0-2053-425f-91ef-9bd878a56936,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:37.647499 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-a1c401bc-3b93-46fc-8493-029bcf665228 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.600s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:37.654690 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-a6379039-d39d-4aa2-a76a-fc29056b13fe None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:37.677208 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e3f81f06-a5bf-40e2-bd4b-db14be73a3fa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:37.719067 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-df64828b-b1af-43ed-96a4-bd2d0d68a08c tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:37.719067 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-df64828b-b1af-43ed-96a4-bd2d0d68a08c tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.48 "GET /v2.0/networks?id=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 HTTP/1.1" status: 200  len: 814 time: 0.6101668
Jun 01 06:13:37.732368 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec53cdc2-33d8-4a53-a6ce-52bf39d56c2c req-3ee8d8a8-f556-40f7-882c-21cd15364c1b tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:37.736459 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e3f81f06-a5bf-40e2-bd4b-db14be73a3fa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:37.739517 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ec53cdc2-33d8-4a53-a6ce-52bf39d56c2c req-3ee8d8a8-f556-40f7-882c-21cd15364c1b tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.3489106
Jun 01 06:13:37.746422 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-b5251705-40f1-4558-a3f6-1fffcc9d61e1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Request body: {'port': {'device_id': 'd96f81cf-f6ef-481f-bebb-b48820741532', 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6', 'admin_state_up': True, 'tenant_id': 'b02068c8f29e4f5e9b3c965d023f7e29'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:37.752714 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:37.772098 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] For port cd6dda6e-46d3-4412-9652-c686f5fad712, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92231) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:13:37.809584 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] For port cd6dda6e-46d3-4412-9652-c686f5fad712, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=cd6dda6e-46d3-4412-9652-c686f5fad712,segment=NetworkSegment(e9a368be-e119-4f56-bdcc-b9d10543e0d8),segment_id=e9a368be-e119-4f56-bdcc-b9d10543e0d8)] {{(pid=92231) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:13:37.820056 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:37.846040 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-9a4b2664-cd3c-4839-8529-0225dd8a45ef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:37.873022 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] Attempting to bind port 110f0bf5-38a0-4190-b9b1-e7dba8cb290e on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:13:37.874171 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] Attempting to bind port 110f0bf5-38a0-4190-b9b1-e7dba8cb290e by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}] {{(pid=92232) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:13:37.874698 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] Attempting to bind port 110f0bf5-38a0-4190-b9b1-e7dba8cb290e on network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:13:37.890032 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 13, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:13:37.890599 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] Checking segment: {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92232) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:13:37.891190 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:37.891729 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] Bound using segment: {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'} {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:13:37.892429 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] Bound port: 110f0bf5-38a0-4190-b9b1-e7dba8cb290e, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}}] {{(pid=92232) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:13:37.892957 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:37.894996 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ec53cdc2-33d8-4a53-a6ce-52bf39d56c2c req-e704a3d8-ce93-467c-b0d1-ef050fc52fe9 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1544170
Jun 01 06:13:37.913533 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port 8c540a0d-e1ed-4b75-9238-d7951633d4bc, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=8c540a0d-e1ed-4b75-9238-d7951633d4bc,segment=NetworkSegment(82caaa19-2534-4a80-96d3-c3f641675978),segment_id=82caaa19-2534-4a80-96d3-c3f641675978)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:13:37.932750 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:37.941658 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e3f81f06-a5bf-40e2-bd4b-db14be73a3fa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:37.950268 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-2752679c-7957-4b67-bd98-b564c63c87f2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:37.975074 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3f81f06-a5bf-40e2-bd4b-db14be73a3fa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=589889b0-2053-425f-91ef-9bd878a56936,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:37.978947 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e3f81f06-a5bf-40e2-bd4b-db14be73a3fa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:37.982804 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_common [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] Allocated IP 172.20.0.1 (5e198e3e-b0b7-4f03-a4b5-1307a1cfe333/8301243f-f3d8-4aba-9f42-177e554580b1/1fa94810-bdd9-40a1-be64-ad8458a57c81) {{(pid=92230) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:13:37.983480 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] Routers {'00ab7a71-e7f7-4524-99c9-7562f23905d1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:13:37.986692 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b250f490>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:13:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['00ab7a71-e7f7-4524-99c9-7562f23905d1'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:37.997449 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e3f81f06-a5bf-40e2-bd4b-db14be73a3fa admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:37.998836 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-e3f81f06-a5bf-40e2-bd4b-db14be73a3fa admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/589889b0-2053-425f-91ef-9bd878a56936 HTTP/1.1" status: 204  len: 168 time: 0.6011882
Jun 01 06:13:38.043283 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fac9b534-d740-4d77-86bb-8b2c13b25da3 req-d506f248-0661-4451-83f8-6647b070e5da tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=d96f81cf-f6ef-481f-bebb-b48820741532 HTTP/1.1" status: 200  len: 210 time: 0.1320009
Jun 01 06:13:38.070344 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c610282-74d9-4827-a3ae-0c88aafbbcae None None] Pushing event updated for resources: {'Port': ['ID=110f0bf5-38a0-4190-b9b1-e7dba8cb290e,revision_number=2']} {{(pid=92232) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:38.082602 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-4c610282-74d9-4827-a3ae-0c88aafbbcae None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.425s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:38.144401 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.db [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] For port 110f0bf5-38a0-4190-b9b1-e7dba8cb290e, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92232) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:13:38.149957 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.db [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] For port 110f0bf5-38a0-4190-b9b1-e7dba8cb290e, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=110f0bf5-38a0-4190-b9b1-e7dba8cb290e,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92232) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:13:38.160195 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:38.180153 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-35596c19-72f7-4ba1-9bdc-3b0a399e5fcb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:38.215169 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-b5251705-40f1-4558-a3f6-1fffcc9d61e1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:38.240317 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-b5251705-40f1-4558-a3f6-1fffcc9d61e1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:38.279770 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-530b10a4-7c6c-480d-ac66-3179f4a65eee req-34d3b247-3251-475d-96ea-7ac34e9da5ba tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:38.281438 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-530b10a4-7c6c-480d-ac66-3179f4a65eee req-34d3b247-3251-475d-96ea-7ac34e9da5ba tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1617184
Jun 01 06:13:38.282602 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-b5251705-40f1-4558-a3f6-1fffcc9d61e1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Made reservation on behalf of b02068c8f29e4f5e9b3c965d023f7e29 for: {'port': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:13:38.286235 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-b5251705-40f1-4558-a3f6-1fffcc9d61e1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:38.318787 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] Routers {'07f2d8c5-b60c-44e0-9523-33ce35fba7c1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:13:38.319368 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b26fa9a0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:13:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['07f2d8c5-b60c-44e0-9523-33ce35fba7c1'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:38.368874 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] Set router 00ab7a71-e7f7-4524-99c9-7562f23905d1 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:13:38.384074 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] Notify callbacks [] for port, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:38.396899 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c610282-74d9-4827-a3ae-0c88aafbbcae None None] Pushing event updated for resources: {'Port': ['ID=110f0bf5-38a0-4190-b9b1-e7dba8cb290e,revision_number=3']} {{(pid=92232) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:38.400563 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-4c610282-74d9-4827-a3ae-0c88aafbbcae None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.229s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:38.411098 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.provisioning_blocks [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] Transition to ACTIVE for port object 1fa94810-bdd9-40a1-be64-ad8458a57c81 will not be triggered until provisioned by entity DHCP. {{(pid=92230) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:13:38.440165 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:38.452439 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:38.461160 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b8214dc-92b4-4856-a39e-d61da4083fe8 None None] Pushing event updated for resources: {'Port': ['ID=cd6dda6e-46d3-4412-9652-c686f5fad712,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:38.471555 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-8b8214dc-92b4-4856-a39e-d61da4083fe8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.626s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:38.518824 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-530b10a4-7c6c-480d-ac66-3179f4a65eee req-c04f2dff-3bba-4c71-9bf5-dce10c006fd4 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1746788
Jun 01 06:13:38.574476 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.612s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:38.593837 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] Network 5e198e3e-b0b7-4f03-a4b5-1307a1cfe333 is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:13:38.596983 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:13:38.627536 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] Received port after_create {{(pid=92230) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:13:38.651928 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] Set router 07f2d8c5-b60c-44e0-9523-33ce35fba7c1 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:13:38.685263 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-b5251705-40f1-4558-a3f6-1fffcc9d61e1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Allocated IP 172.20.0.8 (8c37e9ed-7031-4d7f-bfd1-3763eabba1b6/52a5c0c8-e902-4e55-bfa8-495f043331da/c6e37ad6-d047-468d-9d98-820e15a7165b) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:13:38.691448 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=8c540a0d-e1ed-4b75-9238-d7951633d4bc,revision_number=3']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:38.705493 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:38.728416 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-744049'] for router_interface, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:38.731283 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34632) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:38.760021 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] Pushing event updated for resources: {'Port': ['ID=1fa94810-bdd9-40a1-be64-ad8458a57c81,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:38.765027 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.313s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:38.771045 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b6e577be-92a7-4a8a-9a8c-8fc24a37a29a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:38.773298 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-53d82b24-3735-4375-b74b-0d3b0c5ad28c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:38.805933 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-b6e577be-92a7-4a8a-9a8c-8fc24a37a29a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:38.811829 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-b6e577be-92a7-4a8a-9a8c-8fc24a37a29a admin admin] Usage tracker for resource:security_group_rule and tenant:ddbdf570bd1b4d0481eb5f3b104a108b is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:38.839492 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-b6e577be-92a7-4a8a-9a8c-8fc24a37a29a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:38.847627 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-b6e577be-92a7-4a8a-9a8c-8fc24a37a29a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:39.077639 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:39.111020 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b6e577be-92a7-4a8a-9a8c-8fc24a37a29a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:39.118499 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-ce8a674e-f35a-469f-bbcd-0ef14d87e15c None None] Provisioning for port 1fa94810-bdd9-40a1-be64-ad8458a57c81 completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:13:39.129552 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-ce8a674e-f35a-469f-bbcd-0ef14d87e15c None None] Provisioning complete for port 1fa94810-bdd9-40a1-be64-ad8458a57c81 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:39.130153 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-ce8a674e-f35a-469f-bbcd-0ef14d87e15c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:39.146036 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b6e577be-92a7-4a8a-9a8c-8fc24a37a29a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:39.170306 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-05c5ee00-e81b-4b6d-a7d5-31c85d21f0f1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:39.191584 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-ce8a674e-f35a-469f-bbcd-0ef14d87e15c None None] Port 1fa94810-bdd9-40a1-be64-ad8458a57c81 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:13:39.205742 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b26fa9a0>, [{'id': '07f2d8c5-b60c-44e0-9523-33ce35fba7c1', 'name': 'tempest-TestVolumeBootPattern-1279291552-router', 'tenant_id': '59b1a5cf77d140469fb6596ad2fdef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.224'}], 'enable_snat': True}, 'gw_port_id': '110f0bf5-38a0-4190-b9b1-e7dba8cb290e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:30Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 3, 'project_id': '59b1a5cf77d140469fb6596ad2fdef03', 'gw_port': {'id': '110f0bf5-38a0-4190-b9b1-e7dba8cb290e', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:36:85', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '07f2d8c5-b60c-44e0-9523-33ce35fba7c1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 364, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:32Z', 'updated_at': '2021-06-01T06:13:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:39.211294 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b7324a7-8a41-4345-83f3-c8aa0ff14c35 None None] The sync data for ids ['07f2d8c5-b60c-44e0-9523-33ce35fba7c1'] in dv-cinder-793885-1-iscsi is: [{'id': '07f2d8c5-b60c-44e0-9523-33ce35fba7c1', 'name': 'tempest-TestVolumeBootPattern-1279291552-router', 'tenant_id': '59b1a5cf77d140469fb6596ad2fdef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.224'}], 'enable_snat': True}, 'gw_port_id': '110f0bf5-38a0-4190-b9b1-e7dba8cb290e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:30Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 3, 'project_id': '59b1a5cf77d140469fb6596ad2fdef03', 'gw_port': {'id': '110f0bf5-38a0-4190-b9b1-e7dba8cb290e', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:36:85', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '07f2d8c5-b60c-44e0-9523-33ce35fba7c1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 364, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:32Z', 'updated_at': '2021-06-01T06:13:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}] {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:13:39.226513 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-b5251705-40f1-4558-a3f6-1fffcc9d61e1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:39.237906 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b250f490>, [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': 'cd6dda6e-46d3-4412-9652-c686f5fad712', 'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'mac_address': 'fa:16:3e:aa:f2:09', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:24Z', 'updated_at': '2021-06-01T06:13:37Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'subnets': [{'id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:39.242643 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6e577be-92a7-4a8a-9a8c-8fc24a37a29a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fd6af30f-5caf-40cf-a4ea-c6ff291f0e9f,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:39.243658 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b901c0f8-ff1b-4b79-ae1e-b9c14409e02c None None] The sync data for ids ['00ab7a71-e7f7-4524-99c9-7562f23905d1'] in dv-cinder-793885-1-iscsi is: [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': 'cd6dda6e-46d3-4412-9652-c686f5fad712', 'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'mac_address': 'fa:16:3e:aa:f2:09', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:24Z', 'updated_at': '2021-06-01T06:13:37Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'subnets': [{'id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:13:39.256349 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-b6e577be-92a7-4a8a-9a8c-8fc24a37a29a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:39.259471 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-b6e577be-92a7-4a8a-9a8c-8fc24a37a29a admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=ddbdf570bd1b4d0481eb5f3b104a108b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5251102
Jun 01 06:13:39.265373 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 34644) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:39.358434 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-b5251705-40f1-4558-a3f6-1fffcc9d61e1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:39.377058 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['de8f02a4-b74f-47df-a797-bc3cbe7be366', 'b83de976-8a2a-4caf-b3a4-4f2d2016ddd4', '690a6f90-fdb6-46f4-8f05-03e0ab827f78'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:13:39.379623 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-18a8ce9a-b1c4-406c-9498-41f2209fc07c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:39.428708 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-b5251705-40f1-4558-a3f6-1fffcc9d61e1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Network 8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:13:39.443561 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-b5251705-40f1-4558-a3f6-1fffcc9d61e1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:13:39.460434 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-b5251705-40f1-4558-a3f6-1fffcc9d61e1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:13:39.477530 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-b5251705-40f1-4558-a3f6-1fffcc9d61e1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:39.483044 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-b5251705-40f1-4558-a3f6-1fffcc9d61e1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:39.515777 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] Notify callbacks [] for port, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:39.526709 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2416196'] for port, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:39.567368 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d53c1aa6-fcb6-443c-b696-870f6b183cb7 req-51bce96f-4ff7-4fff-8a39-5dc19d093d54 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:39.570458 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d53c1aa6-fcb6-443c-b696-870f6b183cb7 req-51bce96f-4ff7-4fff-8a39-5dc19d093d54 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.4740231
Jun 01 06:13:39.639872 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-0bb6a3ab-7699-45e0-854e-91cd8e798bcc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:39.739678 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-0bb6a3ab-7699-45e0-854e-91cd8e798bcc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:39.754640 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5251705-40f1-4558-a3f6-1fffcc9d61e1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Pushing event updated for resources: {'Port': ['ID=c6e37ad6-d047-468d-9d98-820e15a7165b,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:39.809621 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b5251705-40f1-4558-a3f6-1fffcc9d61e1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.427s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:39.836720 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:39.837705 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d53c1aa6-fcb6-443c-b696-870f6b183cb7 req-04d41690-c8d1-4e38-9537-25bb06b64c34 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2281106
Jun 01 06:13:39.846710 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-b5251705-40f1-4558-a3f6-1fffcc9d61e1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.1044838
Jun 01 06:13:39.898638 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Request body: {'port': {'device_id': 'd96f81cf-f6ef-481f-bebb-b48820741532', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79388'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:39.917882 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-582666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-744156'] for router_interface, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:39.922558 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] Pushing event updated for resources: {'Port': ['ID=1fa94810-bdd9-40a1-be64-ad8458a57c81,revision_number=2']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:39.926096 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:40.124059 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] Network 5e198e3e-b0b7-4f03-a4b5-1307a1cfe333 is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:13:40.125314 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:13:40.377295 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:40.378703 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 110f0bf5-38a0-4190-b9b1-e7dba8cb290e up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:40.412904 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-0bb6a3ab-7699-45e0-854e-91cd8e798bcc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:40.424216 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-a1c401bc-3b93-46fc-8493-029bcf665228 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:40.495986 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port 110f0bf5-38a0-4190-b9b1-e7dba8cb290e completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:13:40.502873 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 110f0bf5-38a0-4190-b9b1-e7dba8cb290e triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:40.503260 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:40.505177 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] Router 07f2d8c5-b60c-44e0-9523-33ce35fba7c1 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92230) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:13:40.528052 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bb6a3ab-7699-45e0-854e-91cd8e798bcc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fd6af30f-5caf-40cf-a4ea-c6ff291f0e9f,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:40.530681 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-0bb6a3ab-7699-45e0-854e-91cd8e798bcc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:40.555226 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4184f4a5-a857-4578-be30-f7ab39ae725f req-09e8dc8e-de31-4bdf-a534-abe45e53d27d tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:40.556505 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-4184f4a5-a857-4578-be30-f7ab39ae725f req-09e8dc8e-de31-4bdf-a534-abe45e53d27d tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Synchronizing usage tracker for tenant:b02068c8f29e4f5e9b3c965d023f7e29 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:13:40.574608 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-0bb6a3ab-7699-45e0-854e-91cd8e798bcc admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:40.576306 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-0bb6a3ab-7699-45e0-854e-91cd8e798bcc admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/fd6af30f-5caf-40cf-a4ea-c6ff291f0e9f HTTP/1.1" status: 204  len: 168 time: 1.3099334
Jun 01 06:13:40.636755 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-316164aa-4a30-4de6-b486-8c4f141b169c req-692b9eb1-72b5-4bcb-b5e4-a575f1407755 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:40.638565 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-316164aa-4a30-4de6-b486-8c4f141b169c req-692b9eb1-72b5-4bcb-b5e4-a575f1407755 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.6029749
Jun 01 06:13:40.648501 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-014cb847-ab38-44d4-919b-fc6a556e56a9 None None] Provisioning complete for port 1fa94810-bdd9-40a1-be64-ad8458a57c81 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:40.648834 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-014cb847-ab38-44d4-919b-fc6a556e56a9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:40.798179 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-4184f4a5-a857-4578-be30-f7ab39ae725f req-09e8dc8e-de31-4bdf-a534-abe45e53d27d tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Unset dirty status for tenant:b02068c8f29e4f5e9b3c965d023f7e29 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:13:40.799340 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4184f4a5-a857-4578-be30-f7ab39ae725f req-09e8dc8e-de31-4bdf-a534-abe45e53d27d tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=d96f81cf-f6ef-481f-bebb-b48820741532 HTTP/1.1" status: 200  len: 931 time: 0.9399042
Jun 01 06:13:40.879995 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-014cb847-ab38-44d4-919b-fc6a556e56a9 None None] Port 1fa94810-bdd9-40a1-be64-ad8458a57c81 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:13:40.901623 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:40.930246 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:13:40.932588 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port 110f0bf5-38a0-4190-b9b1-e7dba8cb290e, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=110f0bf5-38a0-4190-b9b1-e7dba8cb290e,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:13:40.944412 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:40.945462 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 8c540a0d-e1ed-4b75-9238-d7951633d4bc up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:40.963295 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] 10.222.0.25 "PUT /v2.0/routers/07f2d8c5-b60c-44e0-9523-33ce35fba7c1/add_router_interface HTTP/1.1" status: 200  len: 503 time: 5.3472404
Jun 01 06:13:40.993702 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4184f4a5-a857-4578-be30-f7ab39ae725f req-dbf22d07-1c04-4e1a-9b7f-6dbefeefdf68 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1691718
Jun 01 06:13:41.000326 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-316164aa-4a30-4de6-b486-8c4f141b169c req-a346fd5e-afea-44a6-8d6f-b6dd09201036 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2539058
Jun 01 06:13:41.031355 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:41.307509 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:41.314519 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=110f0bf5-38a0-4190-b9b1-e7dba8cb290e,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:41.317883 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.287s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:41.329663 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 8c540a0d-e1ed-4b75-9238-d7951633d4bc triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:41.330030 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:41.456213 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.db.resource_extend [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] It took 0.22 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
Jun 01 06:13:41.471746 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device cd6dda6e-46d3-4412-9652-c686f5fad712 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:41.546061 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port cd6dda6e-46d3-4412-9652-c686f5fad712 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:13:41.552180 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port cd6dda6e-46d3-4412-9652-c686f5fad712 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:41.552535 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:41.555695 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c6e37ad6-d047-468d-9d98-820e15a7165b {{(pid=92229) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:13:41.566785 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:41.603684 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Transition to ACTIVE for port object c6e37ad6-d047-468d-9d98-820e15a7165b will not be triggered until provisioned by entity L2. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:13:41.619504 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af6808b3-012a-47c5-baf3-3b73281e01ad req-e4ce3b95-9997-44f6-bc23-a2d3544e4b77 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:41.627032 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-af6808b3-012a-47c5-baf3-3b73281e01ad req-e4ce3b95-9997-44f6-bc23-a2d3544e4b77 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.3297687
Jun 01 06:13:41.644594 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:41.650723 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-e1e548e0-b691-4161-8c87-f4c445e2517f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:41.689817 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34dfcc64-b783-44cd-9c34-83988a04ea94 req-f84c305e-a951-48e0-8873-1713a1e099e2 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:41.691245 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-34dfcc64-b783-44cd-9c34-83988a04ea94 req-f84c305e-a951-48e0-8873-1713a1e099e2 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.4615602
Jun 01 06:13:41.750241 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:41.800922 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port cd6dda6e-46d3-4412-9652-c686f5fad712, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=cd6dda6e-46d3-4412-9652-c686f5fad712,segment=NetworkSegment(e9a368be-e119-4f56-bdcc-b9d10543e0d8),segment_id=e9a368be-e119-4f56-bdcc-b9d10543e0d8)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:13:41.812384 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:41.820229 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-ea2a0641-e943-4ea2-af23-879ef1dd1fbf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:41.957652 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=cd6dda6e-46d3-4412-9652-c686f5fad712,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:41.963769 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:41.964007 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-af6808b3-012a-47c5-baf3-3b73281e01ad req-ca6afdb1-f9bc-468f-8c5b-9e3531678184 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.3359301
Jun 01 06:13:42.007314 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Pushing event updated for resources: {'Port': ['ID=c6e37ad6-d047-468d-9d98-820e15a7165b,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:42.033244 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-34dfcc64-b783-44cd-9c34-83988a04ea94 req-f4e6b40d-de84-4569-bf41-a2176a5d76d2 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.3205223
Jun 01 06:13:42.036801 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c8dab1e-83bd-4846-9e4b-a993ef099737 req-99149a8a-ac66-4a66-9ef4-53f2110b3e26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:42.038663 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-3c8dab1e-83bd-4846-9e4b-a993ef099737 req-99149a8a-ac66-4a66-9ef4-53f2110b3e26 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=ac4006667c3442a3910d548e9e9d22c0&device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 1098 time: 0.1644132
Jun 01 06:13:42.044557 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.394s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:42.045647 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Attempting to bind port c6e37ad6-d047-468d-9d98-820e15a7165b on host hv-cinder-79388 for vnic_type normal with profile  {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:13:42.046070 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Attempting to bind port c6e37ad6-d047-468d-9d98-820e15a7165b by drivers openvswitch,hyperv on host hv-cinder-79388 at level 0 using segments [{'id': '7e12089c-d8cc-429c-8b7b-f5d148a55957', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 206, 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6'}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:13:42.047164 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Attempting to bind port c6e37ad6-d047-468d-9d98-820e15a7165b on network 8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:13:42.061402 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Port c6e37ad6-d047-468d-9d98-820e15a7165b on network 8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79388 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 06:13:42.073424 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Attempting to bind port c6e37ad6-d047-468d-9d98-820e15a7165b on network 8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:13:42.090870 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 110f0bf5-38a0-4190-b9b1-e7dba8cb290e up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:42.091222 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Checking agent: {'id': '56148394-2131-4d06-bcfa-c032301591b8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79388', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'started_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 13, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:13:42.092793 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Checking segment: {'id': '7e12089c-d8cc-429c-8b7b-f5d148a55957', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 206, 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:13:42.093353 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Bound using segment: {'id': '7e12089c-d8cc-429c-8b7b-f5d148a55957', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 206, 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6'} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:13:42.093957 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Bound port: c6e37ad6-d047-468d-9d98-820e15a7165b, host: hv-cinder-79388, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7e12089c-d8cc-429c-8b7b-f5d148a55957', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 206, 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6'}}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:13:42.095880 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:42.214552 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] Sync routers for ids ['07f2d8c5-b60c-44e0-9523-33ce35fba7c1'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:13:42.239661 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] Routers {'07f2d8c5-b60c-44e0-9523-33ce35fba7c1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:13:42.241338 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2530160>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:13:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['07f2d8c5-b60c-44e0-9523-33ce35fba7c1'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:42.316984 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c8dab1e-83bd-4846-9e4b-a993ef099737 req-8383aedd-463b-41ec-ba2e-468ce4026f69 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:42.318894 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-3c8dab1e-83bd-4846-9e4b-a993ef099737 req-8383aedd-463b-41ec-ba2e-468ce4026f69 service neutron] 10.222.0.48 "GET /v2.0/networks?id=0890ab9c-2266-4ef4-af73-d3ff421b9bd7 HTTP/1.1" status: 200  len: 912 time: 0.2550526
Jun 01 06:13:42.365680 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] For port c6e37ad6-d047-468d-9d98-820e15a7165b, host hv-cinder-79388, cleared binding levels {{(pid=92229) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:13:42.384951 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] For port c6e37ad6-d047-468d-9d98-820e15a7165b, host hv-cinder-79388, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=c6e37ad6-d047-468d-9d98-820e15a7165b,segment=NetworkSegment(7e12089c-d8cc-429c-8b7b-f5d148a55957),segment_id=7e12089c-d8cc-429c-8b7b-f5d148a55957)] {{(pid=92229) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:13:42.390536 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:42.396060 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b5251705-40f1-4558-a3f6-1fffcc9d61e1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:42.407652 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-bd0c6e62-4d96-46f2-a9c3-777cfb64892d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:42.412190 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 110f0bf5-38a0-4190-b9b1-e7dba8cb290e triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:42.412503 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:42.469799 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:42.470419 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:42.471847 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] 10.222.0.48 "PUT /v2.0/ports/c6e37ad6-d047-468d-9d98-820e15a7165b HTTP/1.1" status: 200  len: 1093 time: 2.5959175
Jun 01 06:13:42.472365 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd96f81cf-f6ef-481f-bebb-b48820741532', 'tag': 'c6e37ad6-d047-468d-9d98-820e15a7165b'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:13:42.474678 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fd2373f1-251d-4c47-855e-d5ff42d22ceb" -d '{"events": [{"name": "network-changed", "server_uuid": "d96f81cf-f6ef-481f-bebb-b48820741532", "tag": "c6e37ad6-d047-468d-9d98-820e15a7165b"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:13:42.515603 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-3c8dab1e-83bd-4846-9e4b-a993ef099737 req-3cda6adb-7899-4c78-b789-2426d461d1dc service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=42597738-974b-4af6-a799-e37d02b057b9 HTTP/1.1" status: 200  len: 1000 time: 0.1885815
Jun 01 06:13:42.541180 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a09e4713-4751-4fe0-966b-e039b2c96652 req-3e4963f7-eaae-4ae2-923f-bfcf4430407e tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:42.549088 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a09e4713-4751-4fe0-966b-e039b2c96652 req-3e4963f7-eaae-4ae2-923f-bfcf4430407e tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.2486248
Jun 01 06:13:42.592743 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Pushing event updated for resources: {'Port': ['ID=c6e37ad6-d047-468d-9d98-820e15a7165b,revision_number=3']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:42.597693 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:42.654759 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] Set router 07f2d8c5-b60c-44e0-9523-33ce35fba7c1 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:13:42.684548 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a09e4713-4751-4fe0-966b-e039b2c96652 req-39b25170-023e-4e22-8152-47208f9791d6 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1330914
Jun 01 06:13:42.704736 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c8dab1e-83bd-4846-9e4b-a993ef099737 req-137abebd-7bc9-4024-9c42-dfad1b0d3c48 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:42.708785 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-3c8dab1e-83bd-4846-9e4b-a993ef099737 req-137abebd-7bc9-4024-9c42-dfad1b0d3c48 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=3e980239-de35-45a0-8039-8395b5408617 HTTP/1.1" status: 200  len: 850 time: 0.1852264
Jun 01 06:13:42.713461 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-5dd0fa64-7ec3-48e3-8896-0aa35192f63f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:42.723519 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-5dd0fa64-7ec3-48e3-8896-0aa35192f63f service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=b02068c8f29e4f5e9b3c965d023f7e29&device_id=d96f81cf-f6ef-481f-bebb-b48820741532 HTTP/1.1" status: 200  len: 1096 time: 0.1706107
Jun 01 06:13:42.878595 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c8dab1e-83bd-4846-9e4b-a993ef099737 req-d554d5c8-fe33-46e9-b1d8-7e96fa5fb063 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:42.884868 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-3c8dab1e-83bd-4846-9e4b-a993ef099737 req-d554d5c8-fe33-46e9-b1d8-7e96fa5fb063 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=0890ab9c-2266-4ef4-af73-d3ff421b9bd7&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1681519
Jun 01 06:13:42.904037 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-8be8d7ef-667c-4bd2-9cb4-1f176a294345 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=c6e37ad6-d047-468d-9d98-820e15a7165b HTTP/1.1" status: 200  len: 217 time: 0.1702957
Jun 01 06:13:42.987951 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-e9c67131-3db1-4394-bc5e-af08b92b650b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:42.989606 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-e9c67131-3db1-4394-bc5e-af08b92b650b service neutron] 10.222.0.48 "GET /v2.0/subnets?id=52a5c0c8-e902-4e55-bfa8-495f043331da HTTP/1.1" status: 200  len: 854 time: 0.0719717
Jun 01 06:13:43.000249 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dea7db45-978b-4941-896f-80cb4cea44ff req-c55365e4-1352-44ba-a59c-aa878633f668 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:43.005478 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-dea7db45-978b-4941-896f-80cb4cea44ff req-c55365e4-1352-44ba-a59c-aa878633f668 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=d96f81cf-f6ef-481f-bebb-b48820741532 HTTP/1.1" status: 200  len: 943 time: 0.1665761
Jun 01 06:13:43.078515 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-a21d86a4-19d2-4a14-9fb4-f08480cd5542 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0704126
Jun 01 06:13:43.127582 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 34718) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:43.139547 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-210b961d-97f2-4a69-9dc3-e5f3e05d662c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1032536289', 'description': 'tempest-secgroup-smoke-1032536289 description', 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:43.185790 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2530160>, [{'id': '07f2d8c5-b60c-44e0-9523-33ce35fba7c1', 'name': 'tempest-TestVolumeBootPattern-1279291552-router', 'tenant_id': '59b1a5cf77d140469fb6596ad2fdef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.224'}], 'enable_snat': True}, 'gw_port_id': '110f0bf5-38a0-4190-b9b1-e7dba8cb290e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:30Z', 'updated_at': '2021-06-01T06:13:38Z', 'revision_number': 4, 'project_id': '59b1a5cf77d140469fb6596ad2fdef03', 'gw_port': {'id': '110f0bf5-38a0-4190-b9b1-e7dba8cb290e', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:36:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '07f2d8c5-b60c-44e0-9523-33ce35fba7c1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 364, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:32Z', 'updated_at': '2021-06-01T06:13:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '1fa94810-bdd9-40a1-be64-ad8458a57c81', 'name': '', 'network_id': '5e198e3e-b0b7-4f03-a4b5-1307a1cfe333', 'tenant_id': '59b1a5cf77d140469fb6596ad2fdef03', 'mac_address': 'fa:16:3e:f0:3a:e3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '07f2d8c5-b60c-44e0-9523-33ce35fba7c1', 'device_owner': 'network:router_interface', 'standard_attr_id': 370, 'fixed_ips': [{'subnet_id': '8301243f-f3d8-4aba-9f42-177e554580b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:37Z', 'updated_at': '2021-06-01T06:13:39Z', 'revision_number': 2, 'project_id': '59b1a5cf77d140469fb6596ad2fdef03', 'subnets': [{'id': '8301243f-f3d8-4aba-9f42-177e554580b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:43.189940 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] Checking router: 07f2d8c5-b60c-44e0-9523-33ce35fba7c1 for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:13:43.190292 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] Updating router 07f2d8c5-b60c-44e0-9523-33ce35fba7c1 port 1fa94810-bdd9-40a1-be64-ad8458a57c81 binding host dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 06:13:43.199216 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:13:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fac906c1-f573-4ac4-ae9d-15fc9dc6c614 x-openstack-request-id: req-fac906c1-f573-4ac4-ae9d-15fc9dc6c614 {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:13:43.200028 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d96f81cf-f6ef-481f-bebb-b48820741532", "tag": "c6e37ad6-d047-468d-9d98-820e15a7165b", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:13:43.200028 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-fac906c1-f573-4ac4-ae9d-15fc9dc6c614 {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:13:43.200416 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd96f81cf-f6ef-481f-bebb-b48820741532', 'tag': 'c6e37ad6-d047-468d-9d98-820e15a7165b', 'status': 'completed', 'code': 200}
Jun 01 06:13:43.201368 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-210b961d-97f2-4a69-9dc3-e5f3e05d662c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:43.222100 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-dea7db45-978b-4941-896f-80cb4cea44ff req-880856f0-23d4-4cc2-a5ba-aaa9b1ab0a2f tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1689343
Jun 01 06:13:43.237438 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-3c8dab1e-83bd-4846-9e4b-a993ef099737 req-8022cdea-a02a-4774-87ec-e8e123cb141c service neutron] 10.222.0.48 "GET /v2.0/networks/0890ab9c-2266-4ef4-af73-d3ff421b9bd7?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3359659
Jun 01 06:13:43.271424 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:43.272480 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:43.274149 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-210b961d-97f2-4a69-9dc3-e5f3e05d662c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Usage tracker for resource:security_group and tenant:e8bcff3fed924886a68a8562a9f4f8f3 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:43.292078 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-210b961d-97f2-4a69-9dc3-e5f3e05d662c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:43.301236 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-210b961d-97f2-4a69-9dc3-e5f3e05d662c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:43.390454 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-210b961d-97f2-4a69-9dc3-e5f3e05d662c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:43.418784 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-1d58edfc-d880-46ec-b1f6-b66191911e22 service neutron] 10.222.0.48 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3293951
Jun 01 06:13:43.443077 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-3c8dab1e-83bd-4846-9e4b-a993ef099737 req-6f4a569e-f5db-480f-b9e4-33ea6ecdc440 service neutron] 10.222.0.48 "GET /v2.0/networks/0890ab9c-2266-4ef4-af73-d3ff421b9bd7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1925247
Jun 01 06:13:43.585311 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-210b961d-97f2-4a69-9dc3-e5f3e05d662c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:43.606570 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-210b961d-97f2-4a69-9dc3-e5f3e05d662c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Usage tracker for resource:security_group_rule and tenant:e8bcff3fed924886a68a8562a9f4f8f3 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:43.615049 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-210b961d-97f2-4a69-9dc3-e5f3e05d662c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:43.627848 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-210b961d-97f2-4a69-9dc3-e5f3e05d662c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:43.719497 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e6c42b9-0135-4e90-8e25-d654cca4f210 req-7ca513b2-258f-421c-8e64-9577fc8778eb tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:43.720924 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5e6c42b9-0135-4e90-8e25-d654cca4f210 req-7ca513b2-258f-421c-8e64-9577fc8778eb tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.3927343
Jun 01 06:13:43.726302 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-32345656-8dc7-4611-a7b9-321d1c5cdabd req-dd674265-eaae-46b8-83af-e22a7a611241 service neutron] 10.222.0.48 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2622743
Jun 01 06:13:43.783526 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9adef60-4710-42fe-b11f-68bae1355ec5 req-ff05f4a4-8c82-470f-ab92-63a37ff5edd4 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:43.783811 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] Notify callbacks [] for port, precommit_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:43.785267 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d9adef60-4710-42fe-b11f-68bae1355ec5 req-ff05f4a4-8c82-470f-ab92-63a37ff5edd4 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.3747187
Jun 01 06:13:43.797101 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] Transition to ACTIVE for port object 1fa94810-bdd9-40a1-be64-ad8458a57c81 will not be triggered until provisioned by entity L2. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:13:43.805160 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:43.812351 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:44.048333 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5e6c42b9-0135-4e90-8e25-d654cca4f210 req-6de1fb11-81a4-4c66-b5ee-f545d718e2f9 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.3159430
Jun 01 06:13:44.087655 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device cd6dda6e-46d3-4412-9652-c686f5fad712 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:44.116940 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9f25f3e-a1ff-4764-9a44-b4d41bbeb628 None None] Pushing event updated for resources: {'Port': ['ID=1fa94810-bdd9-40a1-be64-ad8458a57c81,revision_number=3']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:44.130544 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-a9f25f3e-a1ff-4764-9a44-b4d41bbeb628 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.318s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:44.155746 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-210b961d-97f2-4a69-9dc3-e5f3e05d662c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:44.168937 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d9adef60-4710-42fe-b11f-68bae1355ec5 req-735fa9b2-9459-432f-8255-b67abc3d862d tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.3437726
Jun 01 06:13:44.178340 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-210b961d-97f2-4a69-9dc3-e5f3e05d662c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:44.194518 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-0bb6a3ab-7699-45e0-854e-91cd8e798bcc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:44.206837 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] Attempting to bind port 1fa94810-bdd9-40a1-be64-ad8458a57c81 on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:13:44.220282 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] Attempting to bind port 1fa94810-bdd9-40a1-be64-ad8458a57c81 by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': '82caaa19-2534-4a80-96d3-c3f641675978', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 220, 'network_id': '5e198e3e-b0b7-4f03-a4b5-1307a1cfe333'}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:13:44.220854 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] Attempting to bind port 1fa94810-bdd9-40a1-be64-ad8458a57c81 on network 5e198e3e-b0b7-4f03-a4b5-1307a1cfe333 {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:13:44.257512 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 13, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:13:44.257838 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] Checking segment: {'id': '82caaa19-2534-4a80-96d3-c3f641675978', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 220, 'network_id': '5e198e3e-b0b7-4f03-a4b5-1307a1cfe333'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92231) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:13:44.258313 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:44.259572 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] Bound using segment: {'id': '82caaa19-2534-4a80-96d3-c3f641675978', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 220, 'network_id': '5e198e3e-b0b7-4f03-a4b5-1307a1cfe333'} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:13:44.260312 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] Bound port: 1fa94810-bdd9-40a1-be64-ad8458a57c81, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '82caaa19-2534-4a80-96d3-c3f641675978', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 220, 'network_id': '5e198e3e-b0b7-4f03-a4b5-1307a1cfe333'}}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:13:44.261210 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:44.263157 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd2373f1-251d-4c47-855e-d5ff42d22ceb req-4e0b9d12-6122-4702-ae5f-aeeb34bf4b18 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:44.265014 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fd2373f1-251d-4c47-855e-d5ff42d22ceb req-4e0b9d12-6122-4702-ae5f-aeeb34bf4b18 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=b02068c8f29e4f5e9b3c965d023f7e29&device_id=d96f81cf-f6ef-481f-bebb-b48820741532 HTTP/1.1" status: 200  len: 1096 time: 0.4732361
Jun 01 06:13:44.310835 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port cd6dda6e-46d3-4412-9652-c686f5fad712 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:44.324155 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:44.434474 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-210b961d-97f2-4a69-9dc3-e5f3e05d662c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:44.438761 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-210b961d-97f2-4a69-9dc3-e5f3e05d662c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 1.3073783
Jun 01 06:13:44.439099 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34750) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:44.446073 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-7212a4c0-a8f0-471c-b953-455f5d18c865 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Request body: {'security_group_rule': {'security_group_id': '837b69a3-6811-4cdc-8ade-9ad4352f4196', 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:44.453047 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-7212a4c0-a8f0-471c-b953-455f5d18c865 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:44.457352 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-7212a4c0-a8f0-471c-b953-455f5d18c865 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Usage tracker for resource:security_group_rule and tenant:e8bcff3fed924886a68a8562a9f4f8f3 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:44.460396 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-7212a4c0-a8f0-471c-b953-455f5d18c865 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:44.468036 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-7212a4c0-a8f0-471c-b953-455f5d18c865 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:44.487700 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] For port 1fa94810-bdd9-40a1-be64-ad8458a57c81, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92231) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:13:44.489510 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7212a4c0-a8f0-471c-b953-455f5d18c865 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:44.544812 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] For port 1fa94810-bdd9-40a1-be64-ad8458a57c81, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=1fa94810-bdd9-40a1-be64-ad8458a57c81,segment=NetworkSegment(82caaa19-2534-4a80-96d3-c3f641675978),segment_id=82caaa19-2534-4a80-96d3-c3f641675978)] {{(pid=92231) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:13:44.561390 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:44.565730 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7212a4c0-a8f0-471c-b953-455f5d18c865 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:44.568001 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-580b163c-2819-40fa-b666-25ff4e0679c9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:44.571995 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7212a4c0-a8f0-471c-b953-455f5d18c865 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:44.581522 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-a8b6c945-a7bf-451f-966f-90e7273095d0 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:44.609315 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7212a4c0-a8f0-471c-b953-455f5d18c865 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dd4114aa-a288-4f8e-8e5d-4e2eb8657487,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:44.614561 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-7212a4c0-a8f0-471c-b953-455f5d18c865 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:44.621296 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7212a4c0-a8f0-471c-b953-455f5d18c865 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:44.622844 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-7212a4c0-a8f0-471c-b953-455f5d18c865 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.1820312
Jun 01 06:13:44.625530 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34756) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:44.631486 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-210b961d-97f2-4a69-9dc3-e5f3e05d662c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Pushing event updated for resources: {'SecurityGroup': ['ID=837b69a3-6811-4cdc-8ade-9ad4352f4196,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:44.631950 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-bfd39313-36d2-4a13-bd15-5b3cf2c4d878 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Request body: {'security_group_rule': {'security_group_id': '837b69a3-6811-4cdc-8ade-9ad4352f4196', 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:44.635465 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-210b961d-97f2-4a69-9dc3-e5f3e05d662c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.443s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:44.642641 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-bfd39313-36d2-4a13-bd15-5b3cf2c4d878 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:44.647620 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-bfd39313-36d2-4a13-bd15-5b3cf2c4d878 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Usage tracker for resource:security_group_rule and tenant:e8bcff3fed924886a68a8562a9f4f8f3 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:44.652896 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-bfd39313-36d2-4a13-bd15-5b3cf2c4d878 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:44.660691 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-bfd39313-36d2-4a13-bd15-5b3cf2c4d878 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:44.679813 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] Routers {'07f2d8c5-b60c-44e0-9523-33ce35fba7c1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:13:44.679813 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2530160>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:13:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['07f2d8c5-b60c-44e0-9523-33ce35fba7c1'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:44.689483 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd2373f1-251d-4c47-855e-d5ff42d22ceb req-9460434a-8da5-464a-b9df-3a666dffdc15 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:44.691057 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fd2373f1-251d-4c47-855e-d5ff42d22ceb req-9460434a-8da5-464a-b9df-3a666dffdc15 service neutron] 10.222.0.48 "GET /v2.0/networks?id=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 HTTP/1.1" status: 200  len: 915 time: 0.4074335
Jun 01 06:13:44.694750 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-bfd39313-36d2-4a13-bd15-5b3cf2c4d878 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:44.738399 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe026812-12f1-4794-9018-9242b331909f req-772659c3-3ec7-4701-b2e7-856ab899553a tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:44.739953 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fe026812-12f1-4794-9018-9242b331909f req-772659c3-3ec7-4701-b2e7-856ab899553a tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=d96f81cf-f6ef-481f-bebb-b48820741532 HTTP/1.1" status: 200  len: 943 time: 0.3848903
Jun 01 06:13:44.752409 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9f25f3e-a1ff-4764-9a44-b4d41bbeb628 None None] Pushing event updated for resources: {'Port': ['ID=1fa94810-bdd9-40a1-be64-ad8458a57c81,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:44.758180 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-a9f25f3e-a1ff-4764-9a44-b4d41bbeb628 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:44.758987 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ed61a4e-22a6-4c7d-a602-67d46956becf req-3c58bb87-cb56-41c6-8ac4-80529d8356bb tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:44.767690 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1ed61a4e-22a6-4c7d-a602-67d46956becf req-3c58bb87-cb56-41c6-8ac4-80529d8356bb tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.3304243
Jun 01 06:13:44.943213 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] Set router 07f2d8c5-b60c-44e0-9523-33ce35fba7c1 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:13:44.967246 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-bfd39313-36d2-4a13-bd15-5b3cf2c4d878 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:44.974428 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-bfd39313-36d2-4a13-bd15-5b3cf2c4d878 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:44.976941 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:44.986168 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1ed61a4e-22a6-4c7d-a602-67d46956becf req-e7d83d1c-0470-4966-a24e-1bcc4348f917 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2172580
Jun 01 06:13:45.017193 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fd2373f1-251d-4c47-855e-d5ff42d22ceb req-c552cef4-b891-4896-ab1c-c564c57fc7bc service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=c6e37ad6-d047-468d-9d98-820e15a7165b HTTP/1.1" status: 200  len: 217 time: 0.1484311
Jun 01 06:13:45.020775 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fe026812-12f1-4794-9018-9242b331909f req-69bc0483-b0a8-4984-a722-38aa70d612f9 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2734959
Jun 01 06:13:45.035454 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-bfd39313-36d2-4a13-bd15-5b3cf2c4d878 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:45.048930 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-bfd39313-36d2-4a13-bd15-5b3cf2c4d878 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.4206948
Jun 01 06:13:45.052663 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34766) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:45.053419 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfd39313-36d2-4a13-bd15-5b3cf2c4d878 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3ce99181-b470-4edb-aa88-e8582da8567d,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:45.057131 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-bfd39313-36d2-4a13-bd15-5b3cf2c4d878 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:45.072150 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-9e801ffe-5f57-453a-a66a-fcbabf0da4fe tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Request body: {'security_group_rule': {'security_group_id': '837b69a3-6811-4cdc-8ade-9ad4352f4196', 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:45.085389 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-9e801ffe-5f57-453a-a66a-fcbabf0da4fe tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:45.090350 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-9e801ffe-5f57-453a-a66a-fcbabf0da4fe tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Usage tracker for resource:security_group_rule and tenant:e8bcff3fed924886a68a8562a9f4f8f3 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:45.093508 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-9e801ffe-5f57-453a-a66a-fcbabf0da4fe tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:45.100403 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-9e801ffe-5f57-453a-a66a-fcbabf0da4fe tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:45.119999 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd2373f1-251d-4c47-855e-d5ff42d22ceb req-07a889c9-61f3-48ce-82bd-9e648d0c8ece service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:45.121761 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fd2373f1-251d-4c47-855e-d5ff42d22ceb req-07a889c9-61f3-48ce-82bd-9e648d0c8ece service neutron] 10.222.0.48 "GET /v2.0/subnets?id=52a5c0c8-e902-4e55-bfa8-495f043331da HTTP/1.1" status: 200  len: 854 time: 0.0976989
Jun 01 06:13:45.124852 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9e801ffe-5f57-453a-a66a-fcbabf0da4fe tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:45.223822 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fd2373f1-251d-4c47-855e-d5ff42d22ceb req-fdc5258d-d5e6-48fb-ac48-5b9ee9b137dd service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0882955
Jun 01 06:13:45.252133 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9e801ffe-5f57-453a-a66a-fcbabf0da4fe tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:45.261365 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9e801ffe-5f57-453a-a66a-fcbabf0da4fe tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:45.264028 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:45.294889 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e801ffe-5f57-453a-a66a-fcbabf0da4fe tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d0937b3b-83bb-4719-ae65-f6781aeb7f69,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:45.299909 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-9e801ffe-5f57-453a-a66a-fcbabf0da4fe tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:45.310700 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9e801ffe-5f57-453a-a66a-fcbabf0da4fe tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:45.315644 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-9e801ffe-5f57-453a-a66a-fcbabf0da4fe tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.2545977
Jun 01 06:13:45.316882 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34776) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:45.326677 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-eee27720-2bbe-4ee3-8bf5-a2b67dbc0415 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Request body: {'security_group_rule': {'security_group_id': '837b69a3-6811-4cdc-8ade-9ad4352f4196', 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:45.335539 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-eee27720-2bbe-4ee3-8bf5-a2b67dbc0415 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:45.342982 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-eee27720-2bbe-4ee3-8bf5-a2b67dbc0415 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Usage tracker for resource:security_group_rule and tenant:e8bcff3fed924886a68a8562a9f4f8f3 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:45.349096 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-eee27720-2bbe-4ee3-8bf5-a2b67dbc0415 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:45.366094 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-eee27720-2bbe-4ee3-8bf5-a2b67dbc0415 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:45.390776 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-eee27720-2bbe-4ee3-8bf5-a2b67dbc0415 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:45.441269 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:45.505532 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-eee27720-2bbe-4ee3-8bf5-a2b67dbc0415 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:45.512638 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-eee27720-2bbe-4ee3-8bf5-a2b67dbc0415 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:45.515404 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-2260ee17-0b2c-4650-90fb-a99586cfb14c tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:45.539243 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2530160>, [{'id': '07f2d8c5-b60c-44e0-9523-33ce35fba7c1', 'name': 'tempest-TestVolumeBootPattern-1279291552-router', 'tenant_id': '59b1a5cf77d140469fb6596ad2fdef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.224'}], 'enable_snat': True}, 'gw_port_id': '110f0bf5-38a0-4190-b9b1-e7dba8cb290e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:30Z', 'updated_at': '2021-06-01T06:13:38Z', 'revision_number': 4, 'project_id': '59b1a5cf77d140469fb6596ad2fdef03', 'gw_port': {'id': '110f0bf5-38a0-4190-b9b1-e7dba8cb290e', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:36:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '07f2d8c5-b60c-44e0-9523-33ce35fba7c1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 364, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:32Z', 'updated_at': '2021-06-01T06:13:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '1fa94810-bdd9-40a1-be64-ad8458a57c81', 'name': '', 'network_id': '5e198e3e-b0b7-4f03-a4b5-1307a1cfe333', 'tenant_id': '59b1a5cf77d140469fb6596ad2fdef03', 'mac_address': 'fa:16:3e:f0:3a:e3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '07f2d8c5-b60c-44e0-9523-33ce35fba7c1', 'device_owner': 'network:router_interface', 'standard_attr_id': 370, 'fixed_ips': [{'subnet_id': '8301243f-f3d8-4aba-9f42-177e554580b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:37Z', 'updated_at': '2021-06-01T06:13:44Z', 'revision_number': 4, 'project_id': '59b1a5cf77d140469fb6596ad2fdef03', 'subnets': [{'id': '8301243f-f3d8-4aba-9f42-177e554580b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:13:45.545347 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1697eff9-94ad-465f-9541-1367ee99ee5a None None] The sync data for ids ['07f2d8c5-b60c-44e0-9523-33ce35fba7c1'] in dv-cinder-793885-1-iscsi is: [{'id': '07f2d8c5-b60c-44e0-9523-33ce35fba7c1', 'name': 'tempest-TestVolumeBootPattern-1279291552-router', 'tenant_id': '59b1a5cf77d140469fb6596ad2fdef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.224'}], 'enable_snat': True}, 'gw_port_id': '110f0bf5-38a0-4190-b9b1-e7dba8cb290e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:30Z', 'updated_at': '2021-06-01T06:13:38Z', 'revision_number': 4, 'project_id': '59b1a5cf77d140469fb6596ad2fdef03', 'gw_port': {'id': '110f0bf5-38a0-4190-b9b1-e7dba8cb290e', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:36:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '07f2d8c5-b60c-44e0-9523-33ce35fba7c1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 364, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:32Z', 'updated_at': '2021-06-01T06:13:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '1fa94810-bdd9-40a1-be64-ad8458a57c81', 'name': '', 'network_id': '5e198e3e-b0b7-4f03-a4b5-1307a1cfe333', 'tenant_id': '59b1a5cf77d140469fb6596ad2fdef03', 'mac_address': 'fa:16:3e:f0:3a:e3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '07f2d8c5-b60c-44e0-9523-33ce35fba7c1', 'device_owner': 'network:router_interface', 'standard_attr_id': 370, 'fixed_ips': [{'subnet_id': '8301243f-f3d8-4aba-9f42-177e554580b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:37Z', 'updated_at': '2021-06-01T06:13:44Z', 'revision_number': 4, 'project_id': '59b1a5cf77d140469fb6596ad2fdef03', 'subnets': [{'id': '8301243f-f3d8-4aba-9f42-177e554580b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:13:45.552903 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eee27720-2bbe-4ee3-8bf5-a2b67dbc0415 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=23ef65d9-ea22-4f51-8731-1defb3309924,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:45.557076 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-eee27720-2bbe-4ee3-8bf5-a2b67dbc0415 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:45.582238 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-eee27720-2bbe-4ee3-8bf5-a2b67dbc0415 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:45.585223 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-eee27720-2bbe-4ee3-8bf5-a2b67dbc0415 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.2628937
Jun 01 06:13:45.586177 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34782) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:45.587556 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34784) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:45.621625 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-3c0fcd03-9e34-4d90-8299-2e3604940e7a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Request body: {'security_group_rule': {'security_group_id': '837b69a3-6811-4cdc-8ade-9ad4352f4196', 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:45.636205 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-3c0fcd03-9e34-4d90-8299-2e3604940e7a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:45.642256 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-3c0fcd03-9e34-4d90-8299-2e3604940e7a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Usage tracker for resource:security_group_rule and tenant:e8bcff3fed924886a68a8562a9f4f8f3 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:45.647996 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-3c0fcd03-9e34-4d90-8299-2e3604940e7a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:45.657674 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device c6e37ad6-d047-468d-9d98-820e15a7165b details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:13:45.660764 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-3c0fcd03-9e34-4d90-8299-2e3604940e7a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:45.689457 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fd2373f1-251d-4c47-855e-d5ff42d22ceb req-e5bac6e5-5c30-4d86-a059-414d1adb8438 service neutron] 10.222.0.48 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4522805
Jun 01 06:13:45.693395 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.db.securitygroups_db [None req-3c0fcd03-9e34-4d90-8299-2e3604940e7a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Project e8bcff3fed924886a68a8562a9f4f8f3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 06:13:45.706912 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f6aee42-dfd9-493e-89b0-61f4819620b2 req-c9065bf2-4e50-4af9-95d2-9881879385b5 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:45.709532 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3c0fcd03-9e34-4d90-8299-2e3604940e7a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:45.714125 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1f6aee42-dfd9-493e-89b0-61f4819620b2 req-c9065bf2-4e50-4af9-95d2-9881879385b5 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.4411376
Jun 01 06:13:45.857013 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db701948-55ae-4177-95d8-31586c674173 req-bf7a9fac-9f43-44a1-84a6-41a9843da850 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:45.858569 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-db701948-55ae-4177-95d8-31586c674173 req-bf7a9fac-9f43-44a1-84a6-41a9843da850 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.3652713
Jun 01 06:13:45.869667 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3c0fcd03-9e34-4d90-8299-2e3604940e7a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:45.885303 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3c0fcd03-9e34-4d90-8299-2e3604940e7a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:45.893561 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-6f8d7678-a49a-4bd8-b5e6-e7e29d0b01a1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:45.904245 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-507be55f-3405-4757-bb8c-c38c8ee8b237 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:45.914296 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1f6aee42-dfd9-493e-89b0-61f4819620b2 req-778955f4-8113-4207-ba1c-e6318234cd9c tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1992927
Jun 01 06:13:45.945133 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c0fcd03-9e34-4d90-8299-2e3604940e7a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e24a22cd-952b-47a7-9eb3-3bfe53eb077f,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:45.948608 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-3c0fcd03-9e34-4d90-8299-2e3604940e7a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:45.953654 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port c6e37ad6-d047-468d-9d98-820e15a7165b, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=c6e37ad6-d047-468d-9d98-820e15a7165b,segment=NetworkSegment(7e12089c-d8cc-429c-8b7b-f5d148a55957),segment_id=7e12089c-d8cc-429c-8b7b-f5d148a55957)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:13:45.957019 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-6f8d7678-a49a-4bd8-b5e6-e7e29d0b01a1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:45.962229 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-6f8d7678-a49a-4bd8-b5e6-e7e29d0b01a1 admin admin] Usage tracker for resource:security_group_rule and tenant:94144827c7da4583a20803e819dab675 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:45.966638 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3c0fcd03-9e34-4d90-8299-2e3604940e7a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:45.970316 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-3c0fcd03-9e34-4d90-8299-2e3604940e7a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.3655624
Jun 01 06:13:45.970316 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-6f8d7678-a49a-4bd8-b5e6-e7e29d0b01a1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:45.971970 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34794) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:45.980752 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-3ee364b0-6dec-4dce-9e67-8005e34c7065 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Request body: {'security_group_rule': {'security_group_id': '837b69a3-6811-4cdc-8ade-9ad4352f4196', 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:45.986408 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-6f8d7678-a49a-4bd8-b5e6-e7e29d0b01a1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:45.987538 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': 'c6e37ad6-d047-468d-9d98-820e15a7165b', 'network_id': '8c37e9ed-7031-4d7f-bfd1-3763eabba1b6', 'port_id': 'c6e37ad6-d047-468d-9d98-820e15a7165b', 'mac_address': 'fa:16:3e:26:48:a4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 206, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '52a5c0c8-e902-4e55-bfa8-495f043331da', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:13:45.989410 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-3ee364b0-6dec-4dce-9e67-8005e34c7065 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:45.993268 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:45.996353 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-3ee364b0-6dec-4dce-9e67-8005e34c7065 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Usage tracker for resource:security_group_rule and tenant:e8bcff3fed924886a68a8562a9f4f8f3 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:46.002921 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-3ee364b0-6dec-4dce-9e67-8005e34c7065 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:46.004545 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-db701948-55ae-4177-95d8-31586c674173 req-2bc30949-9c9a-4435-9534-1526b711e27b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1288371
Jun 01 06:13:46.020274 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-3ee364b0-6dec-4dce-9e67-8005e34c7065 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:46.075011 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.db.securitygroups_db [None req-3ee364b0-6dec-4dce-9e67-8005e34c7065 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Project e8bcff3fed924886a68a8562a9f4f8f3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 06:13:46.082028 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fd2373f1-251d-4c47-855e-d5ff42d22ceb req-82457af6-4c7c-40c2-8e83-57a2727706fa service neutron] 10.222.0.48 "GET /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3652003
Jun 01 06:13:46.099304 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3ee364b0-6dec-4dce-9e67-8005e34c7065 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:46.107729 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:46.140145 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c6e37ad6-d047-468d-9d98-820e15a7165b {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:13:46.183542 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 1fa94810-bdd9-40a1-be64-ad8458a57c81 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:46.263053 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-6f8d7678-a49a-4bd8-b5e6-e7e29d0b01a1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:46.269387 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3ee364b0-6dec-4dce-9e67-8005e34c7065 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:46.273141 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-6f8d7678-a49a-4bd8-b5e6-e7e29d0b01a1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:46.283815 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-38eb2264-2557-476f-b8c6-3966a2504cdf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:46.295532 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3ee364b0-6dec-4dce-9e67-8005e34c7065 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:46.313204 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port c6e37ad6-d047-468d-9d98-820e15a7165b, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=c6e37ad6-d047-468d-9d98-820e15a7165b,segment=NetworkSegment(7e12089c-d8cc-429c-8b7b-f5d148a55957),segment_id=7e12089c-d8cc-429c-8b7b-f5d148a55957)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:13:46.327958 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:46.332210 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:46.354897 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f8d7678-a49a-4bd8-b5e6-e7e29d0b01a1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e1d16db9-2b6e-49f9-9f42-87362a543bb9,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:46.366870 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-6f8d7678-a49a-4bd8-b5e6-e7e29d0b01a1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:46.368985 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.061s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:46.396213 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ee364b0-6dec-4dce-9e67-8005e34c7065 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=37128505-5fc8-4bbb-8766-e881e46d328a,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:46.404673 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-6f8d7678-a49a-4bd8-b5e6-e7e29d0b01a1 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=94144827c7da4583a20803e819dab675&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8040717
Jun 01 06:13:46.407465 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 34806) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:46.410117 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-3ee364b0-6dec-4dce-9e67-8005e34c7065 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:46.419439 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3ee364b0-6dec-4dce-9e67-8005e34c7065 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:46.424781 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-3ee364b0-6dec-4dce-9e67-8005e34c7065 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.4511871
Jun 01 06:13:46.430092 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=c6e37ad6-d047-468d-9d98-820e15a7165b,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:46.435431 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:46.444925 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port 1fa94810-bdd9-40a1-be64-ad8458a57c81 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:13:46.451542 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 1fa94810-bdd9-40a1-be64-ad8458a57c81 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:46.451887 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:46.471173 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b83c9ab-6ec6-4475-9e65-76698cc6dad7 req-3bf789d4-7f0b-466e-8cea-474b48cb0d49 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:46.478640 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5b83c9ab-6ec6-4475-9e65-76698cc6dad7 req-3bf789d4-7f0b-466e-8cea-474b48cb0d49 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.2848980
Jun 01 06:13:46.523063 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e089f966-a317-45d0-8ced-b3b0cd0b6981 req-5483f045-4737-4584-9c92-ebd1181bce9a tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:46.523225 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e089f966-a317-45d0-8ced-b3b0cd0b6981 req-5483f045-4737-4584-9c92-ebd1181bce9a tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=d96f81cf-f6ef-481f-bebb-b48820741532 HTTP/1.1" status: 200  len: 944 time: 0.2716784
Jun 01 06:13:46.612652 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:46.629323 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5b83c9ab-6ec6-4475-9e65-76698cc6dad7 req-dc602e5d-f4ed-4087-9305-3aa23397cda2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1494696
Jun 01 06:13:46.633071 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3387cbbf-c502-4edb-aa01-d2be387d1033 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:46.662911 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e089f966-a317-45d0-8ced-b3b0cd0b6981 req-c7dca17c-1097-45ea-ad67-060e028d9c68 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1185389
Jun 01 06:13:46.685118 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3387cbbf-c502-4edb-aa01-d2be387d1033 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:46.712584 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port 1fa94810-bdd9-40a1-be64-ad8458a57c81, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=1fa94810-bdd9-40a1-be64-ad8458a57c81,segment=NetworkSegment(82caaa19-2534-4a80-96d3-c3f641675978),segment_id=82caaa19-2534-4a80-96d3-c3f641675978)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:13:46.718169 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:46.723296 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-8b8214dc-92b4-4856-a39e-d61da4083fe8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:46.773089 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3387cbbf-c502-4edb-aa01-d2be387d1033 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:46.784238 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-7682a4a7-68cc-4e15-92ea-e589e94ecfcf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:46.784838 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['c6e37ad6-d047-468d-9d98-820e15a7165b'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:13:46.807626 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3387cbbf-c502-4edb-aa01-d2be387d1033 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:46.808932 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-3387cbbf-c502-4edb-aa01-d2be387d1033 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/e1d16db9-2b6e-49f9-9f42-87362a543bb9 HTTP/1.1" status: 204  len: 168 time: 0.3989332
Jun 01 06:13:46.810410 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3387cbbf-c502-4edb-aa01-d2be387d1033 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e1d16db9-2b6e-49f9-9f42-87362a543bb9,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:46.819207 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-3387cbbf-c502-4edb-aa01-d2be387d1033 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:46.902019 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=1fa94810-bdd9-40a1-be64-ad8458a57c81,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:46.906525 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:47.262947 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78180181-33dc-41c9-bd56-9e04c9dc62b1 req-02f2973d-701a-4e06-85ef-48d9bed76a18 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:47.271221 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-78180181-33dc-41c9-bd56-9e04c9dc62b1 req-02f2973d-701a-4e06-85ef-48d9bed76a18 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.1957481
Jun 01 06:13:47.286724 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 34866) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:47.315339 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f17e76aa-6471-4df4-8077-0762684557cd admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:47.340870 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-f17e76aa-6471-4df4-8077-0762684557cd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:47.346014 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-f17e76aa-6471-4df4-8077-0762684557cd admin admin] Usage tracker for resource:security_group_rule and tenant:c100350ed4a44237929a368be86c11fd is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:47.349251 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-f17e76aa-6471-4df4-8077-0762684557cd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:47.356542 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-78180181-33dc-41c9-bd56-9e04c9dc62b1 req-c0878f74-4c3f-47d6-a713-ba740f8943bf tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0841372
Jun 01 06:13:47.362974 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-f17e76aa-6471-4df4-8077-0762684557cd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:47.376709 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5fdcc13-1396-4986-b810-fcebb999cbc4 req-64ad0b38-3d18-4a30-8fec-35838c8259d9 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:47.385162 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d5fdcc13-1396-4986-b810-fcebb999cbc4 req-64ad0b38-3d18-4a30-8fec-35838c8259d9 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.2095997
Jun 01 06:13:47.455956 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d5fdcc13-1396-4986-b810-fcebb999cbc4 req-12603d4b-12bf-46f4-916b-cb113afca26b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0698175
Jun 01 06:13:47.471031 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f17e76aa-6471-4df4-8077-0762684557cd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:47.475085 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f17e76aa-6471-4df4-8077-0762684557cd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:47.487628 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-83f37f76-266d-4a24-9756-b01b4244b2b8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:47.527903 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-f17e76aa-6471-4df4-8077-0762684557cd admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=c100350ed4a44237929a368be86c11fd&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2394907
Jun 01 06:13:47.529477 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f17e76aa-6471-4df4-8077-0762684557cd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=32802fdf-ab4c-43d2-991d-072a6ea4258f,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:47.530671 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 34870) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:13:47.532708 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-f17e76aa-6471-4df4-8077-0762684557cd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:47.690981 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-361f48c9-ee67-4471-a45a-d0f3bbad7da4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:47.763595 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-361f48c9-ee67-4471-a45a-d0f3bbad7da4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:47.979809 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f11bfe2-fc4b-4604-85c0-e0ee1eb1a2e1 req-42fb8cc5-57ae-4923-99c0-9adc12252b62 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:47.981285 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7f11bfe2-fc4b-4604-85c0-e0ee1eb1a2e1 req-42fb8cc5-57ae-4923-99c0-9adc12252b62 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 1098 time: 0.2629697
Jun 01 06:13:47.997762 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-194f9a2a-9e45-4841-9953-b5d8f5d6db71 req-87a35872-131b-4b54-890f-52d36fed6c2c tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:47.999380 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-194f9a2a-9e45-4841-9953-b5d8f5d6db71 req-87a35872-131b-4b54-890f-52d36fed6c2c tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.2391305
Jun 01 06:13:48.014657 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-361f48c9-ee67-4471-a45a-d0f3bbad7da4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:48.024413 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b8fd9a9a-6297-4764-9801-ec795c9edb9a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:48.028458 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 1fa94810-bdd9-40a1-be64-ad8458a57c81 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:48.065544 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361f48c9-ee67-4471-a45a-d0f3bbad7da4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=32802fdf-ab4c-43d2-991d-072a6ea4258f,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:48.068461 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-361f48c9-ee67-4471-a45a-d0f3bbad7da4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:48.093447 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6d9b015-e50d-4647-b3b7-fdbb18da35a7 req-57ef6be4-d25a-43ab-9195-649a3151a89f tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:48.094841 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a6d9b015-e50d-4647-b3b7-fdbb18da35a7 req-57ef6be4-d25a-43ab-9195-649a3151a89f tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=d96f81cf-f6ef-481f-bebb-b48820741532 HTTP/1.1" status: 200  len: 944 time: 0.2412679
Jun 01 06:13:48.097895 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-361f48c9-ee67-4471-a45a-d0f3bbad7da4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:48.101450 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-361f48c9-ee67-4471-a45a-d0f3bbad7da4 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/32802fdf-ab4c-43d2-991d-072a6ea4258f HTTP/1.1" status: 204  len: 168 time: 0.5662670
Jun 01 06:13:48.110351 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 1fa94810-bdd9-40a1-be64-ad8458a57c81 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:48.110724 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:48.134165 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7f11bfe2-fc4b-4604-85c0-e0ee1eb1a2e1 req-c903dfa4-b693-4342-831d-0b10e706b947 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1330707
Jun 01 06:13:48.159381 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-194f9a2a-9e45-4841-9953-b5d8f5d6db71 req-f19c681f-e689-481a-aea9-59c0ea6fc020 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1393070
Jun 01 06:13:48.170628 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a6d9b015-e50d-4647-b3b7-fdbb18da35a7 req-d07f8610-7d55-40b2-a9bd-2a41ecff4df8 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0628436
Jun 01 06:13:48.567539 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f079510a-2283-4cd7-a07c-89811cc02d25 req-5c78c781-3e97-4d9d-a93f-2496673c7854 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:48.574950 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f079510a-2283-4cd7-a07c-89811cc02d25 req-5c78c781-3e97-4d9d-a93f-2496673c7854 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.1304550
Jun 01 06:13:48.689883 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f079510a-2283-4cd7-a07c-89811cc02d25 req-b5adf581-d9e0-4c08-8335-5add11fe30de tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0779445
Jun 01 06:13:48.711332 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f73a9591-b23a-4815-aeb2-71c3889bfd64 req-5a22010e-3a36-43af-8f25-3e38e82e2ef5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:48.713998 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f73a9591-b23a-4815-aeb2-71c3889bfd64 req-5a22010e-3a36-43af-8f25-3e38e82e2ef5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.1371229
Jun 01 06:13:48.767068 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f73a9591-b23a-4815-aeb2-71c3889bfd64 req-73f1c7d6-b9d5-40ff-81e7-8e24f42f61ca tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0471315
Jun 01 06:13:49.453179 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d2d47a3-f947-4e94-a31f-291cec4f5359 req-cfd4658c-9d40-41d8-aaaa-152296175f40 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:49.454693 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7d2d47a3-f947-4e94-a31f-291cec4f5359 req-cfd4658c-9d40-41d8-aaaa-152296175f40 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=d96f81cf-f6ef-481f-bebb-b48820741532 HTTP/1.1" status: 200  len: 944 time: 0.1617317
Jun 01 06:13:49.467997 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa84bd24-2da8-492d-a0f4-7eca772ea9d7 req-fa3f5f3e-0f06-49ca-b51c-ccc480d4c361 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:49.469483 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fa84bd24-2da8-492d-a0f4-7eca772ea9d7 req-fa3f5f3e-0f06-49ca-b51c-ccc480d4c361 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1416509
Jun 01 06:13:49.542970 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7d2d47a3-f947-4e94-a31f-291cec4f5359 req-20a0c440-762c-4a1f-8e04-4e6b330b2bce tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0725369
Jun 01 06:13:49.553313 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fa84bd24-2da8-492d-a0f4-7eca772ea9d7 req-de6d5964-05b6-41ac-89dd-b709fa50662a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0651424
Jun 01 06:13:49.674983 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device c6e37ad6-d047-468d-9d98-820e15a7165b up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:13:49.753467 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning for port c6e37ad6-d047-468d-9d98-820e15a7165b completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:13:49.761461 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port c6e37ad6-d047-468d-9d98-820e15a7165b triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:49.764309 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:49.963830 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:49.998859 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd96f81cf-f6ef-481f-bebb-b48820741532', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c6e37ad6-d047-468d-9d98-820e15a7165b'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:13:50.001840 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7d78fb68-8acd-467b-a436-66fe1f086e54" -d '{"events": [{"server_uuid": "d96f81cf-f6ef-481f-bebb-b48820741532", "name": "network-vif-plugged", "status": "completed", "tag": "c6e37ad6-d047-468d-9d98-820e15a7165b"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:13:50.011147 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port c6e37ad6-d047-468d-9d98-820e15a7165b, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=c6e37ad6-d047-468d-9d98-820e15a7165b,segment=NetworkSegment(7e12089c-d8cc-429c-8b7b-f5d148a55957),segment_id=7e12089c-d8cc-429c-8b7b-f5d148a55957)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:13:50.016650 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:50.022684 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:50.098518 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=c6e37ad6-d047-468d-9d98-820e15a7165b,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:50.102081 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:50.126334 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7058f24b-850f-4679-9cbb-cc4bad24694c req-ab1ff142-3016-48ea-a858-bf9c73cdc28e tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:50.127940 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7058f24b-850f-4679-9cbb-cc4bad24694c req-ab1ff142-3016-48ea-a858-bf9c73cdc28e tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.2771492
Jun 01 06:13:50.182261 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8533df29-90ce-41c3-bbe3-88076ba38bb8 req-a2bc588a-5d7a-4775-bb4b-a8ddf0ca8d58 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:50.183762 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8533df29-90ce-41c3-bbe3-88076ba38bb8 req-a2bc588a-5d7a-4775-bb4b-a8ddf0ca8d58 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=8f1cf739e243401eb5da7ee705e856de&device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 1098 time: 0.2232876
Jun 01 06:13:50.197160 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bda9cfe0-bed7-4af2-ac11-7782069b711c req-b2d12d59-a52d-41bb-86fe-a92a6c7cf7aa tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:50.198678 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bda9cfe0-bed7-4af2-ac11-7782069b711c req-b2d12d59-a52d-41bb-86fe-a92a6c7cf7aa tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.1880457
Jun 01 06:13:50.234734 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7058f24b-850f-4679-9cbb-cc4bad24694c req-2256d189-db60-4ef9-b0fd-50892cd4b9a4 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0976934
Jun 01 06:13:50.345153 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bda9cfe0-bed7-4af2-ac11-7782069b711c req-9df9c3ac-4707-42d8-b3d6-9fcb6e21b5d8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1209154
Jun 01 06:13:50.415988 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:13:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-536894fc-d571-44a5-a8c6-30a4c1a9b095 x-openstack-request-id: req-536894fc-d571-44a5-a8c6-30a4c1a9b095 {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:13:50.416523 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d96f81cf-f6ef-481f-bebb-b48820741532", "name": "network-vif-plugged", "status": "completed", "tag": "c6e37ad6-d047-468d-9d98-820e15a7165b", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:13:50.416926 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-536894fc-d571-44a5-a8c6-30a4c1a9b095 {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:13:50.417290 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd96f81cf-f6ef-481f-bebb-b48820741532', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c6e37ad6-d047-468d-9d98-820e15a7165b', 'code': 200}
Jun 01 06:13:50.451400 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8533df29-90ce-41c3-bbe3-88076ba38bb8 req-9269d252-7a88-4846-b38b-ecff3c6df235 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:50.452911 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8533df29-90ce-41c3-bbe3-88076ba38bb8 req-9269d252-7a88-4846-b38b-ecff3c6df235 service neutron] 10.222.0.48 "GET /v2.0/networks?id=6e45a0e5-f930-4b18-8f4f-1693815eb31a HTTP/1.1" status: 200  len: 919 time: 0.2533882
Jun 01 06:13:50.484677 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c968b188-6acd-4c90-a1f5-d65f2080b0cd req-737e9c06-c178-4e33-aada-4ca952ce9b3a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:50.486486 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c968b188-6acd-4c90-a1f5-d65f2080b0cd req-737e9c06-c178-4e33-aada-4ca952ce9b3a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1259456
Jun 01 06:13:50.566797 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8533df29-90ce-41c3-bbe3-88076ba38bb8 req-e8f4e586-8a5b-4a92-a691-2dc4c40b729b service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5f320f89-ada2-472d-b9ac-0676b4c4b578 HTTP/1.1" status: 200  len: 217 time: 0.0794647
Jun 01 06:13:50.669371 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c968b188-6acd-4c90-a1f5-d65f2080b0cd req-6c7c643d-5595-477d-9730-a6747b23fedb tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1012368
Jun 01 06:13:50.679374 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8533df29-90ce-41c3-bbe3-88076ba38bb8 req-021d2208-bf22-4a94-96a2-d393754156a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:50.681088 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8533df29-90ce-41c3-bbe3-88076ba38bb8 req-021d2208-bf22-4a94-96a2-d393754156a3 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=84c296fc-69c0-46e2-b1ed-e3edf435b759 HTTP/1.1" status: 200  len: 858 time: 0.0952837
Jun 01 06:13:50.756438 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f79ea03a-174f-4c07-b2cc-91943883f743 req-373086aa-e3a8-4f19-9ab7-d080ed3efc7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:50.759400 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-f79ea03a-174f-4c07-b2cc-91943883f743 req-373086aa-e3a8-4f19-9ab7-d080ed3efc7a service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=d96f81cf-f6ef-481f-bebb-b48820741532 HTTP/1.1" status: 200  len: 1098 time: 0.1458323
Jun 01 06:13:50.779490 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8533df29-90ce-41c3-bbe3-88076ba38bb8 req-520e0f57-68fd-4df5-a9e9-8c7432bd63d1 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=6e45a0e5-f930-4b18-8f4f-1693815eb31a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0892296
Jun 01 06:13:50.809880 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-f79ea03a-174f-4c07-b2cc-91943883f743 req-f4e229d1-af58-45ba-ae9a-19b385aa49b3 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409079
Jun 01 06:13:50.986124 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-798e225d-24d7-4e89-a001-589416eeac91 req-5ac8fd97-f88d-4ec3-b6d4-f5122aecc5f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:50.987614 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-798e225d-24d7-4e89-a001-589416eeac91 req-5ac8fd97-f88d-4ec3-b6d4-f5122aecc5f3 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=ac4006667c3442a3910d548e9e9d22c0&device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 1098 time: 0.0860314
Jun 01 06:13:51.079859 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59147b58-88f7-4840-80cf-5850bb5be51c req-c4c219a5-c33d-4911-a922-5d201091a1fd tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:51.081386 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-59147b58-88f7-4840-80cf-5850bb5be51c req-c4c219a5-c33d-4911-a922-5d201091a1fd tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=d96f81cf-f6ef-481f-bebb-b48820741532 HTTP/1.1" status: 200  len: 945 time: 0.3927312
Jun 01 06:13:51.121820 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8533df29-90ce-41c3-bbe3-88076ba38bb8 req-ef67678b-05f5-48b8-8564-95872c891f02 service neutron] 10.222.0.48 "GET /v2.0/networks/6e45a0e5-f930-4b18-8f4f-1693815eb31a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3281934
Jun 01 06:13:51.145959 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-798e225d-24d7-4e89-a001-589416eeac91 req-a65e49c0-58fa-421b-8e49-187be309df42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:51.152386 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-798e225d-24d7-4e89-a001-589416eeac91 req-a65e49c0-58fa-421b-8e49-187be309df42 service neutron] 10.222.0.48 "GET /v2.0/networks?id=0890ab9c-2266-4ef4-af73-d3ff421b9bd7 HTTP/1.1" status: 200  len: 912 time: 0.1514201
Jun 01 06:13:51.175889 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc107010-2993-4e32-a508-1a08799015a0 req-ab96aaa5-cbb8-45f0-90ce-a5cb4c4e5ba9 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:51.177335 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bc107010-2993-4e32-a508-1a08799015a0 req-ab96aaa5-cbb8-45f0-90ce-a5cb4c4e5ba9 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.2178187
Jun 01 06:13:51.183874 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-59147b58-88f7-4840-80cf-5850bb5be51c req-eca11819-dff9-4638-9f33-dbe37a2b7671 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0911798
Jun 01 06:13:51.267250 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-798e225d-24d7-4e89-a001-589416eeac91 req-335ada23-18c9-47e3-b8f2-94ba032985d8 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=42597738-974b-4af6-a799-e37d02b057b9 HTTP/1.1" status: 200  len: 1000 time: 0.1030672
Jun 01 06:13:51.302846 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bc107010-2993-4e32-a508-1a08799015a0 req-0559de31-249b-4b62-97b9-dbda97366613 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1177578
Jun 01 06:13:51.325174 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8533df29-90ce-41c3-bbe3-88076ba38bb8 req-30348286-0790-487e-b066-576e35332038 service neutron] 10.222.0.48 "GET /v2.0/networks/6e45a0e5-f930-4b18-8f4f-1693815eb31a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1863577
Jun 01 06:13:51.338203 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-798e225d-24d7-4e89-a001-589416eeac91 req-acc4f11a-16a8-40c7-9d44-68cc3678981e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:51.339654 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-798e225d-24d7-4e89-a001-589416eeac91 req-acc4f11a-16a8-40c7-9d44-68cc3678981e service neutron] 10.222.0.48 "GET /v2.0/subnets?id=3e980239-de35-45a0-8039-8395b5408617 HTTP/1.1" status: 200  len: 850 time: 0.0637369
Jun 01 06:13:51.444278 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-798e225d-24d7-4e89-a001-589416eeac91 req-d8e51c6f-ec47-42b4-8978-bffdeb8f5257 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:51.445802 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-798e225d-24d7-4e89-a001-589416eeac91 req-d8e51c6f-ec47-42b4-8978-bffdeb8f5257 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=0890ab9c-2266-4ef4-af73-d3ff421b9bd7&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0885448
Jun 01 06:13:51.553305 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e4f14f1-7695-4579-8357-1d5b0a8b7a1e req-92cebd4f-3f48-464a-99ed-b1b1b56acf84 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:51.554785 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9e4f14f1-7695-4579-8357-1d5b0a8b7a1e req-92cebd4f-3f48-464a-99ed-b1b1b56acf84 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.0841465
Jun 01 06:13:51.586006 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-798e225d-24d7-4e89-a001-589416eeac91 req-6aac120a-35e9-410b-9e8e-ccafd3719ab8 service neutron] 10.222.0.48 "GET /v2.0/networks/0890ab9c-2266-4ef4-af73-d3ff421b9bd7?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1299815
Jun 01 06:13:51.606184 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9e4f14f1-7695-4579-8357-1d5b0a8b7a1e req-1128e5e2-fa33-48dd-8211-325d210a9c29 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0442603
Jun 01 06:13:51.731812 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-798e225d-24d7-4e89-a001-589416eeac91 req-31c376ff-670c-4460-8dc2-1037cce3c2e9 service neutron] 10.222.0.48 "GET /v2.0/networks/0890ab9c-2266-4ef4-af73-d3ff421b9bd7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1359048
Jun 01 06:13:51.889493 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cde0e035-ff54-4f2d-a6ed-dac95b8f6a34 req-7cba0061-c3ab-4330-8370-b3813b15f56f tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:51.891736 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cde0e035-ff54-4f2d-a6ed-dac95b8f6a34 req-7cba0061-c3ab-4330-8370-b3813b15f56f tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.0828085
Jun 01 06:13:51.941784 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cde0e035-ff54-4f2d-a6ed-dac95b8f6a34 req-dc066bec-64a1-4b49-b0c1-1f407c34f4ef tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0440273
Jun 01 06:13:52.377237 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e6d4656-3eeb-4aaf-abfe-6667e99d04f0 req-61eef1a4-e39a-4d3f-aad1-8823e80f0f0d tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:52.378638 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3e6d4656-3eeb-4aaf-abfe-6667e99d04f0 req-61eef1a4-e39a-4d3f-aad1-8823e80f0f0d tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=d96f81cf-f6ef-481f-bebb-b48820741532 HTTP/1.1" status: 200  len: 945 time: 0.0878713
Jun 01 06:13:52.458066 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3e6d4656-3eeb-4aaf-abfe-6667e99d04f0 req-ff7a1892-8873-4178-9ea0-48f85141438c tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0722053
Jun 01 06:13:52.513450 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dbf54da-b7fe-4864-848e-5b346fa2c134 req-425e45bb-c203-4dd5-b6b7-f790ea003e4e tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:52.514943 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8dbf54da-b7fe-4864-848e-5b346fa2c134 req-425e45bb-c203-4dd5-b6b7-f790ea003e4e tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.0895066
Jun 01 06:13:52.562316 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8dbf54da-b7fe-4864-848e-5b346fa2c134 req-c282189f-85fe-4727-80df-2f6fd76c3cba tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0416584
Jun 01 06:13:52.811085 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd68ff31-b814-4568-88cb-f2055a94d952 req-287430ba-1985-4cb2-b0e3-64748592c8e9 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:52.812672 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bd68ff31-b814-4568-88cb-f2055a94d952 req-287430ba-1985-4cb2-b0e3-64748592c8e9 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.0892704
Jun 01 06:13:52.859343 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bd68ff31-b814-4568-88cb-f2055a94d952 req-88ada244-618a-4213-a971-c4f661870eee tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0402691
Jun 01 06:13:53.143132 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2bafef3-b450-4cb9-a072-b0d334a0d810 req-fa7eef09-64b7-408b-81ca-708076ec2379 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:53.144736 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c2bafef3-b450-4cb9-a072-b0d334a0d810 req-fa7eef09-64b7-408b-81ca-708076ec2379 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.0919869
Jun 01 06:13:53.192372 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c2bafef3-b450-4cb9-a072-b0d334a0d810 req-c067a45b-5d35-4d1a-bbdf-265bf973a15d tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408449
Jun 01 06:13:53.510390 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-41e44765-197b-41b8-9858-ace27fe1174b tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-346298564&fields=id&tenant_id=60be617f683c42a081ab3f50c3bdf8f1 HTTP/1.1" status: 200  len: 267 time: 0.0403402
Jun 01 06:13:53.725352 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-5c717c77-c4c5-494a-9a44-aa8641941673 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:53.726689 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-5c717c77-c4c5-494a-9a44-aa8641941673 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/networks?id=6200246e-b324-4384-a0a9-6dc6726e2c6d HTTP/1.1" status: 200  len: 809 time: 0.2097175
Jun 01 06:13:53.748822 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1faf2c09-43f0-4469-9ecf-c307df8f0ea5 req-08cfeff5-f90b-4321-ad47-174820559439 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:53.750225 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1faf2c09-43f0-4469-9ecf-c307df8f0ea5 req-08cfeff5-f90b-4321-ad47-174820559439 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=d96f81cf-f6ef-481f-bebb-b48820741532 HTTP/1.1" status: 200  len: 945 time: 0.1489820
Jun 01 06:13:53.752372 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-370c4432-aa8b-4114-85a5-69006212b4a9 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/quotas/60be617f683c42a081ab3f50c3bdf8f1 HTTP/1.1" status: 200  len: 375 time: 0.0192764
Jun 01 06:13:53.841740 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1faf2c09-43f0-4469-9ecf-c307df8f0ea5 req-5f1ae568-84e2-48f0-b659-2f219cb2dfb7 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0859809
Jun 01 06:13:53.869543 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-43f62c21-e0d7-457c-8fef-4c35bfab43dc tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=60be617f683c42a081ab3f50c3bdf8f1&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1006222
Jun 01 06:13:54.073335 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-9dc87da9-e727-4a1e-9e58-f5631850fe93 service neutron] 10.222.0.25 "GET /v2.0/networks/6200246e-b324-4384-a0a9-6dc6726e2c6d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1916068
Jun 01 06:13:54.112407 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-565d2ca9-8d94-4750-b810-192caf601120 req-71e8bf3f-2fef-428f-893d-43b42de4a28a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:54.113893 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-565d2ca9-8d94-4750-b810-192caf601120 req-71e8bf3f-2fef-428f-893d-43b42de4a28a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.1594515
Jun 01 06:13:54.326716 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-565d2ca9-8d94-4750-b810-192caf601120 req-835b95a7-c919-406a-bfe4-2eefaa2a7049 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1610789
Jun 01 06:13:54.350683 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-02fefa86-b51a-40e1-804e-9acd8bad75cf service neutron] 10.222.0.25 "GET /v2.0/networks/6200246e-b324-4384-a0a9-6dc6726e2c6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2695880
Jun 01 06:13:54.554557 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e03e470b-9171-433e-b8d0-e5bb09afd2ec req-c68ae21d-5e36-4d3f-87b9-b23e80291498 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:54.556053 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e03e470b-9171-433e-b8d0-e5bb09afd2ec req-c68ae21d-5e36-4d3f-87b9-b23e80291498 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.0886760
Jun 01 06:13:54.606311 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e03e470b-9171-433e-b8d0-e5bb09afd2ec req-3e23b0e2-cb6d-4e71-b3c9-92c16efb865b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0442233
Jun 01 06:13:54.796274 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-76380725-0f96-4367-96ff-cc6e4ade7286 req-a9989d98-f4dd-460b-a657-b13a28f7e680 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 210 time: 0.0474789
Jun 01 06:13:54.945388 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d49e2360-5e94-4f5d-8920-6e0edfd06e05 req-a4158134-b488-4cd4-ae1f-43b86d63ad09 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:54.947543 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d49e2360-5e94-4f5d-8920-6e0edfd06e05 req-a4158134-b488-4cd4-ae1f-43b86d63ad09 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.0908711
Jun 01 06:13:54.998293 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d49e2360-5e94-4f5d-8920-6e0edfd06e05 req-391c8db3-934a-43b0-a09b-4ba642057889 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0449629
Jun 01 06:13:55.810822 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e79788a-cedd-45a5-8856-6a1fb66d53db req-9defafca-3229-493a-b80e-d3eaadd8672e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:55.812270 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2e79788a-cedd-45a5-8856-6a1fb66d53db req-9defafca-3229-493a-b80e-d3eaadd8672e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.0901568
Jun 01 06:13:55.867502 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2e79788a-cedd-45a5-8856-6a1fb66d53db req-808aef4c-ca90-46e0-a5de-a883ad7b9e0b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0491722
Jun 01 06:13:56.055774 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d05aa1eb-8b9c-4a28-a3b0-30d8a409d477 req-4d0601e2-74ed-4d73-8969-01bb3c1862a6 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 210 time: 0.0613675
Jun 01 06:13:56.230220 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-f72096be-8817-4ebb-a748-a8482f97c06d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:56.230942 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-f72096be-8817-4ebb-a748-a8482f97c06d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Synchronizing usage tracker for tenant:60be617f683c42a081ab3f50c3bdf8f1 on resource:network {{(pid=92230) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:13:56.252409 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-f72096be-8817-4ebb-a748-a8482f97c06d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Unset dirty status for tenant:60be617f683c42a081ab3f50c3bdf8f1 on resource:network {{(pid=92230) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:13:56.253634 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-f72096be-8817-4ebb-a748-a8482f97c06d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.48 "GET /v2.0/networks?id=6200246e-b324-4384-a0a9-6dc6726e2c6d HTTP/1.1" status: 200  len: 809 time: 0.2003949
Jun 01 06:13:56.319836 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-6adcfeeb-642d-452a-b581-80bd25f1ce62 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Synchronizing usage tracker for tenant:60be617f683c42a081ab3f50c3bdf8f1 on resource:security_group {{(pid=92230) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:13:56.341854 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-6adcfeeb-642d-452a-b581-80bd25f1ce62 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Unset dirty status for tenant:60be617f683c42a081ab3f50c3bdf8f1 on resource:security_group {{(pid=92230) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:13:56.342995 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-6adcfeeb-642d-452a-b581-80bd25f1ce62 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.48 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=60be617f683c42a081ab3f50c3bdf8f1 HTTP/1.1" status: 200  len: 379 time: 0.0653877
Jun 01 06:13:56.359393 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-b0eb5084-3482-4d15-92fe-5f2f314fb572 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Request body: {'port': {'device_id': 'a8503e6f-cd18-456e-9b8d-c60b093a7c7f', 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d', 'admin_state_up': True, 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'security_groups': ['659a9ce0-c758-4944-9feb-468439eee519']}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:56.582811 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-b0eb5084-3482-4d15-92fe-5f2f314fb572 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:13:56.586780 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-b0eb5084-3482-4d15-92fe-5f2f314fb572 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Usage tracker for resource:port and tenant:60be617f683c42a081ab3f50c3bdf8f1 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:13:56.590012 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-b0eb5084-3482-4d15-92fe-5f2f314fb572 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Quota usage for port was recalculated. Used quota:2. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:13:56.596387 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-b0eb5084-3482-4d15-92fe-5f2f314fb572 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:13:56.607888 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-b0eb5084-3482-4d15-92fe-5f2f314fb572 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Made reservation on behalf of 60be617f683c42a081ab3f50c3bdf8f1 for: {'port': 1} {{(pid=92230) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:13:56.611458 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-b0eb5084-3482-4d15-92fe-5f2f314fb572 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:56.734908 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d09bd55-c40b-4f6e-9dda-16763adf8baa req-9bd89dcf-e97a-4933-804f-c5d4f2ed610a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:56.736439 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9d09bd55-c40b-4f6e-9dda-16763adf8baa req-9bd89dcf-e97a-4933-804f-c5d4f2ed610a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.0833824
Jun 01 06:13:56.786518 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9d09bd55-c40b-4f6e-9dda-16763adf8baa req-d69a1ff2-18bd-4d44-9f0d-c585e0a47d18 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0442104
Jun 01 06:13:56.795969 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_common [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-b0eb5084-3482-4d15-92fe-5f2f314fb572 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Allocated IP 172.20.0.11 (6200246e-b324-4384-a0a9-6dc6726e2c6d/1fbcd64f-1378-4ec3-bd16-df65964c6028/6c07ed73-1eed-4e63-90ca-60843e890090) {{(pid=92230) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:13:57.009394 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-b0eb5084-3482-4d15-92fe-5f2f314fb572 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for port, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:57.027610 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.provisioning_blocks [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-b0eb5084-3482-4d15-92fe-5f2f314fb572 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Transition to ACTIVE for port object 6c07ed73-1eed-4e63-90ca-60843e890090 will not be triggered until provisioned by entity DHCP. {{(pid=92230) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:13:57.053794 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-b0eb5084-3482-4d15-92fe-5f2f314fb572 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:57.062716 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:57.089541 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0479186d-896a-48db-b32a-66b8c23d87b1 req-e8ed84d5-ef98-425e-bbeb-2188bd038f1e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:57.090087 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0479186d-896a-48db-b32a-66b8c23d87b1 req-e8ed84d5-ef98-425e-bbeb-2188bd038f1e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.0989389
Jun 01 06:13:57.141096 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-b0eb5084-3482-4d15-92fe-5f2f314fb572 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Network 6200246e-b324-4384-a0a9-6dc6726e2c6d is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:13:57.144675 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-b0eb5084-3482-4d15-92fe-5f2f314fb572 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:13:57.147734 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-b0eb5084-3482-4d15-92fe-5f2f314fb572 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Received port after_create {{(pid=92230) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:13:57.166701 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0479186d-896a-48db-b32a-66b8c23d87b1 req-73ed8bcc-209d-4e8d-a4dc-3a6650713e2d tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0697901
Jun 01 06:13:57.207906 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0eb5084-3482-4d15-92fe-5f2f314fb572 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Pushing event updated for resources: {'Port': ['ID=6c07ed73-1eed-4e63-90ca-60843e890090,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:57.212210 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-b0eb5084-3482-4d15-92fe-5f2f314fb572 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:57.251836 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-b0eb5084-3482-4d15-92fe-5f2f314fb572 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:57.252527 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-b0eb5084-3482-4d15-92fe-5f2f314fb572 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for port, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:57.286173 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-b0eb5084-3482-4d15-92fe-5f2f314fb572 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.9303393
Jun 01 06:13:57.301477 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Request body: {'port': {'device_id': 'a8503e6f-cd18-456e-9b8d-c60b093a7c7f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79388'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:13:57.409694 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f19bdd8c-d646-4bb7-8e29-813712118b4c req-277ed595-7a22-4c4b-b068-16502eecb6bc tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:57.419411 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f19bdd8c-d646-4bb7-8e29-813712118b4c req-277ed595-7a22-4c4b-b068-16502eecb6bc tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 932 time: 0.1170094
Jun 01 06:13:57.480473 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f19bdd8c-d646-4bb7-8e29-813712118b4c req-9f9ad28a-4d70-43b6-ba78-3b1ded2c8165 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0601654
Jun 01 06:13:57.510908 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-8b943925-2a44-415f-aec1-92e4ed16b569 None None] Provisioning for port 6c07ed73-1eed-4e63-90ca-60843e890090 completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:13:57.514531 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:57.516037 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-8b943925-2a44-415f-aec1-92e4ed16b569 None None] Provisioning complete for port 6c07ed73-1eed-4e63-90ca-60843e890090 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:13:57.516411 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-8b943925-2a44-415f-aec1-92e4ed16b569 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:57.581351 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-8b943925-2a44-415f-aec1-92e4ed16b569 None None] Port 6c07ed73-1eed-4e63-90ca-60843e890090 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:13:57.715443 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:13:57.895883 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.notifiers.nova [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6c07ed73-1eed-4e63-90ca-60843e890090 {{(pid=92230) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:13:57.903487 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:57.919863 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.provisioning_blocks [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Transition to ACTIVE for port object 6c07ed73-1eed-4e63-90ca-60843e890090 will not be triggered until provisioned by entity L2. {{(pid=92230) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:13:57.923883 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2416196'] for port, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:57.927428 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-ad5731d8-5fdd-4baf-bc4d-6b423997c177 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:58.089913 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Pushing event updated for resources: {'Port': ['ID=6c07ed73-1eed-4e63-90ca-60843e890090,revision_number=2']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:58.093004 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:58.173550 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.managers [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Attempting to bind port 6c07ed73-1eed-4e63-90ca-60843e890090 on host hv-cinder-79388 for vnic_type normal with profile  {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:13:58.173954 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.managers [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Attempting to bind port 6c07ed73-1eed-4e63-90ca-60843e890090 by drivers openvswitch,hyperv on host hv-cinder-79388 at level 0 using segments [{'id': 'fd926c6b-9e42-4104-afe3-51ec344ecdd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 222, 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d'}] {{(pid=92230) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:13:58.174205 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Attempting to bind port 6c07ed73-1eed-4e63-90ca-60843e890090 on network 6200246e-b324-4384-a0a9-6dc6726e2c6d {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:13:58.180806 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Port 6c07ed73-1eed-4e63-90ca-60843e890090 on network 6200246e-b324-4384-a0a9-6dc6726e2c6d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79388 {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 06:13:58.181280 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Attempting to bind port 6c07ed73-1eed-4e63-90ca-60843e890090 on network 6200246e-b324-4384-a0a9-6dc6726e2c6d {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:13:58.187459 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Checking agent: {'id': '56148394-2131-4d06-bcfa-c032301591b8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79388', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'started_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 13, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:13:58.187940 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Checking segment: {'id': 'fd926c6b-9e42-4104-afe3-51ec344ecdd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 222, 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92230) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:13:58.188469 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Bound using segment: {'id': 'fd926c6b-9e42-4104-afe3-51ec344ecdd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 222, 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d'} {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:13:58.189072 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.managers [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Bound port: 6c07ed73-1eed-4e63-90ca-60843e890090, host: hv-cinder-79388, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fd926c6b-9e42-4104-afe3-51ec344ecdd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 222, 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d'}}] {{(pid=92230) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:13:58.189528 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:58.285627 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] For port 6c07ed73-1eed-4e63-90ca-60843e890090, host hv-cinder-79388, cleared binding levels {{(pid=92230) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:13:58.288711 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] For port 6c07ed73-1eed-4e63-90ca-60843e890090, host hv-cinder-79388, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=6c07ed73-1eed-4e63-90ca-60843e890090,segment=NetworkSegment(fd926c6b-9e42-4104-afe3-51ec344ecdd5),segment_id=fd926c6b-9e42-4104-afe3-51ec344ecdd5)] {{(pid=92230) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:13:58.294504 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2416196'] for port, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:58.299205 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:13:58.360992 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:58.361613 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for port, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:13:58.363585 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] 10.222.0.48 "PUT /v2.0/ports/6c07ed73-1eed-4e63-90ca-60843e890090 HTTP/1.1" status: 200  len: 1094 time: 1.0674512
Jun 01 06:13:58.363585 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a8503e6f-cd18-456e-9b8d-c60b093a7c7f', 'tag': '6c07ed73-1eed-4e63-90ca-60843e890090'}] {{(pid=92230) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:13:58.365936 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a8971187fdc179bafebfda031591b22633150c3ea1d9449252a7819502f19756" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e6b55258-e902-4c44-9b99-010e2dc019f3" -d '{"events": [{"name": "network-changed", "server_uuid": "a8503e6f-cd18-456e-9b8d-c60b093a7c7f", "tag": "6c07ed73-1eed-4e63-90ca-60843e890090"}]}' {{(pid=92230) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:13:58.390029 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Pushing event updated for resources: {'Port': ['ID=6c07ed73-1eed-4e63-90ca-60843e890090,revision_number=3']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:13:58.394684 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:13:58.408246 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cd10c32-a7b0-4a29-8a4f-8bceebe65e66 req-402105c2-dabd-4823-9b8f-faa8b02c0e8b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:58.417002 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8cd10c32-a7b0-4a29-8a4f-8bceebe65e66 req-402105c2-dabd-4823-9b8f-faa8b02c0e8b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.1203923
Jun 01 06:13:58.465800 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8cd10c32-a7b0-4a29-8a4f-8bceebe65e66 req-1d5be2a4-f416-414c-892e-81681b619f24 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0478768
Jun 01 06:13:58.513646 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:13:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-68e99647-4acb-4411-98be-3b65484ed3b9 x-openstack-request-id: req-68e99647-4acb-4411-98be-3b65484ed3b9 {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:13:58.514282 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a8503e6f-cd18-456e-9b8d-c60b093a7c7f", "tag": "6c07ed73-1eed-4e63-90ca-60843e890090", "status": "completed", "code": 200}]} {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:13:58.514878 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-68e99647-4acb-4411-98be-3b65484ed3b9 {{(pid=92230) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:13:58.517732 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a8503e6f-cd18-456e-9b8d-c60b093a7c7f', 'tag': '6c07ed73-1eed-4e63-90ca-60843e890090', 'status': 'completed', 'code': 200}
Jun 01 06:13:58.550206 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-97b7543d-94ef-4b28-a9b9-5ee010752f6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:58.551777 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-97b7543d-94ef-4b28-a9b9-5ee010752f6c service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=60be617f683c42a081ab3f50c3bdf8f1&device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 1097 time: 0.1325254
Jun 01 06:13:58.663682 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-1efdc958-14d8-43b1-aa02-a3ee046a1567 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=6c07ed73-1eed-4e63-90ca-60843e890090 HTTP/1.1" status: 200  len: 217 time: 0.1026387
Jun 01 06:13:58.737492 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3555683f-6e36-4f69-b9e5-b45038d44f54 req-6d50262b-78db-4332-8c2b-1b83ba7514ae tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:58.738869 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3555683f-6e36-4f69-b9e5-b45038d44f54 req-6d50262b-78db-4332-8c2b-1b83ba7514ae tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 944 time: 0.0873811
Jun 01 06:13:58.744747 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-8f16deb4-8909-41d3-aae5-0b2577f3822b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:58.746184 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-8f16deb4-8909-41d3-aae5-0b2577f3822b service neutron] 10.222.0.48 "GET /v2.0/subnets?id=1fbcd64f-1378-4ec3-bd16-df65964c6028 HTTP/1.1" status: 200  len: 848 time: 0.0704002
Jun 01 06:13:58.788994 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3555683f-6e36-4f69-b9e5-b45038d44f54 req-ef1a51d6-d96e-4043-b5a0-9a6bc6a0f712 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0418406
Jun 01 06:13:58.843943 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-f2372a79-53c0-4e69-9d3d-3eee75b9a5d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:58.845387 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-f2372a79-53c0-4e69-9d3d-3eee75b9a5d0 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=6200246e-b324-4384-a0a9-6dc6726e2c6d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0841362
Jun 01 06:13:59.051415 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-072ecc16-53bb-451e-864f-2ae849b8ff77 service neutron] 10.222.0.48 "GET /v2.0/networks/6200246e-b324-4384-a0a9-6dc6726e2c6d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1975570
Jun 01 06:13:59.201379 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-7e59210d-625f-4c3b-ae8e-f127e819144a req-189f862c-abc2-46d5-912f-bf97303f3939 service neutron] 10.222.0.48 "GET /v2.0/networks/6200246e-b324-4384-a0a9-6dc6726e2c6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1326020
Jun 01 06:13:59.322239 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6b55258-e902-4c44-9b99-010e2dc019f3 req-9310a67c-013c-4c12-9c78-ac613f6280de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:59.323642 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-e6b55258-e902-4c44-9b99-010e2dc019f3 req-9310a67c-013c-4c12-9c78-ac613f6280de service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=60be617f683c42a081ab3f50c3bdf8f1&device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 1097 time: 0.0750203
Jun 01 06:13:59.468810 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6b55258-e902-4c44-9b99-010e2dc019f3 req-e03acdef-eb99-4e9e-a3c9-fb2924ca6129 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:59.470251 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-e6b55258-e902-4c44-9b99-010e2dc019f3 req-e03acdef-eb99-4e9e-a3c9-fb2924ca6129 service neutron] 10.222.0.48 "GET /v2.0/networks?id=6200246e-b324-4384-a0a9-6dc6726e2c6d HTTP/1.1" status: 200  len: 910 time: 0.1372371
Jun 01 06:13:59.548255 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-e6b55258-e902-4c44-9b99-010e2dc019f3 req-28cbda39-f1d3-43ad-954b-fd06fc9a8b02 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=6c07ed73-1eed-4e63-90ca-60843e890090 HTTP/1.1" status: 200  len: 217 time: 0.0680823
Jun 01 06:13:59.619058 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6b55258-e902-4c44-9b99-010e2dc019f3 req-36e25feb-9042-4de3-bf3e-704a39cd5ebe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:59.620607 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-e6b55258-e902-4c44-9b99-010e2dc019f3 req-36e25feb-9042-4de3-bf3e-704a39cd5ebe service neutron] 10.222.0.48 "GET /v2.0/subnets?id=1fbcd64f-1378-4ec3-bd16-df65964c6028 HTTP/1.1" status: 200  len: 848 time: 0.0639262
Jun 01 06:13:59.699877 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eb480c1-23a5-4f4b-9633-f5710336d086 req-a66bbcd3-ebee-4894-8aa7-3b4b4cb21915 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:59.701468 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9eb480c1-23a5-4f4b-9633-f5710336d086 req-a66bbcd3-ebee-4894-8aa7-3b4b4cb21915 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.1124911
Jun 01 06:13:59.725049 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6b55258-e902-4c44-9b99-010e2dc019f3 req-a93ecf8a-5f60-406b-ae2a-1b66c0a817c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:59.727085 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-e6b55258-e902-4c44-9b99-010e2dc019f3 req-a93ecf8a-5f60-406b-ae2a-1b66c0a817c3 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=6200246e-b324-4384-a0a9-6dc6726e2c6d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0942407
Jun 01 06:13:59.753653 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9eb480c1-23a5-4f4b-9633-f5710336d086 req-c8dccd92-b74c-4e77-9d86-fedfe7258e64 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0462103
Jun 01 06:13:59.882431 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-e6b55258-e902-4c44-9b99-010e2dc019f3 req-32006336-bba9-4e76-8534-ea2a2517967f service neutron] 10.222.0.48 "GET /v2.0/networks/6200246e-b324-4384-a0a9-6dc6726e2c6d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1453178
Jun 01 06:13:59.993427 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5847155e-818d-4e07-bcf2-9636248c224a req-86fc83fa-4bf8-4e98-b692-d64032035549 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:13:59.995062 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5847155e-818d-4e07-bcf2-9636248c224a req-86fc83fa-4bf8-4e98-b692-d64032035549 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 944 time: 0.0940335
Jun 01 06:14:00.025202 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-e6b55258-e902-4c44-9b99-010e2dc019f3 req-5f60c336-0c4d-40e8-b00d-8c3e6d814cb4 service neutron] 10.222.0.48 "GET /v2.0/networks/6200246e-b324-4384-a0a9-6dc6726e2c6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1312509
Jun 01 06:14:00.046391 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5847155e-818d-4e07-bcf2-9636248c224a req-3833e050-a0f1-4469-9e89-9816aebac05e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0442715
Jun 01 06:14:00.951728 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c29ce54e-623f-4f63-8d91-3841d4f9d9a4 req-d1c35700-601e-48ca-b181-d15b4df242eb tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:00.953216 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c29ce54e-623f-4f63-8d91-3841d4f9d9a4 req-d1c35700-601e-48ca-b181-d15b4df242eb tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.0837691
Jun 01 06:14:01.003808 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c29ce54e-623f-4f63-8d91-3841d4f9d9a4 req-33639bd8-eab6-4bf5-94fe-44262bc9e803 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0449359
Jun 01 06:14:01.236086 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2a32623-839e-4b04-a5a0-7c42f7c6a908 req-bc15c5ff-cbd6-4a20-9b0e-96aa3ce5d6b3 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:01.237541 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d2a32623-839e-4b04-a5a0-7c42f7c6a908 req-bc15c5ff-cbd6-4a20-9b0e-96aa3ce5d6b3 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 944 time: 0.0841429
Jun 01 06:14:01.283042 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d2a32623-839e-4b04-a5a0-7c42f7c6a908 req-5e5c195f-2b89-4f07-a3c5-df7ad2e46fd4 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0396121
Jun 01 06:14:01.715402 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 826848c6-a93a-4712-82dd-39e403bcb79e details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:14:01.849739 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 826848c6-a93a-4712-82dd-39e403bcb79e, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=826848c6-a93a-4712-82dd-39e403bcb79e,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:14:01.873269 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': '826848c6-a93a-4712-82dd-39e403bcb79e', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'port_id': '826848c6-a93a-4712-82dd-39e403bcb79e', 'mac_address': 'fa:16:3e:c4:14:7a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 245, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:14:01.929584 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:01.953706 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 826848c6-a93a-4712-82dd-39e403bcb79e {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:14:01.970643 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 826848c6-a93a-4712-82dd-39e403bcb79e, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=826848c6-a93a-4712-82dd-39e403bcb79e,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:14:01.976983 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:01.980229 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:02.048738 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=826848c6-a93a-4712-82dd-39e403bcb79e,revision_number=6']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:02.052145 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:02.212480 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8273fe94-daf6-46b2-b0af-740252922863 req-a4cb9cf1-545c-47af-a424-72601f434181 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:02.216768 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8273fe94-daf6-46b2-b0af-740252922863 req-a4cb9cf1-545c-47af-a424-72601f434181 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 944 time: 0.0932341
Jun 01 06:14:02.220994 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['826848c6-a93a-4712-82dd-39e403bcb79e'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:14:02.273179 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8273fe94-daf6-46b2-b0af-740252922863 req-816912d6-e6d3-4bf0-acfd-a037a0cd5469 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0487087
Jun 01 06:14:02.476668 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1423656d-162b-4195-9f89-ffa05e07bcce req-97bdcf0d-11bb-4dd2-9b93-2a456443c4a9 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:02.477990 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1423656d-162b-4195-9f89-ffa05e07bcce req-97bdcf0d-11bb-4dd2-9b93-2a456443c4a9 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 944 time: 0.0859342
Jun 01 06:14:02.524314 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1423656d-162b-4195-9f89-ffa05e07bcce req-3d2fef3a-12da-4e78-9b61-f01a5b3f52f2 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0397937
Jun 01 06:14:03.468339 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7fb2100-f669-4b3e-99ac-658d6beb1ea8 req-6c49557d-8b0e-4b7c-a3c0-d1a217304b35 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:03.469795 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e7fb2100-f669-4b3e-99ac-658d6beb1ea8 req-6c49557d-8b0e-4b7c-a3c0-d1a217304b35 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 944 time: 0.0819435
Jun 01 06:14:03.520100 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e7fb2100-f669-4b3e-99ac-658d6beb1ea8 req-43652f4d-8bdf-476e-9ab8-b8cede0166f0 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0445504
Jun 01 06:14:03.713057 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caa9fdb1-531a-4c7d-a52b-b06d64029531 req-f1d7d9a1-0ac6-42e1-8811-d57fa4292b34 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:03.714529 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-caa9fdb1-531a-4c7d-a52b-b06d64029531 req-f1d7d9a1-0ac6-42e1-8811-d57fa4292b34 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 944 time: 0.0814693
Jun 01 06:14:03.724475 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 826848c6-a93a-4712-82dd-39e403bcb79e up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:14:03.763187 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-caa9fdb1-531a-4c7d-a52b-b06d64029531 req-bab08832-c73a-4ab5-948d-20a8ce4b6f07 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0427377
Jun 01 06:14:03.803922 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port 826848c6-a93a-4712-82dd-39e403bcb79e triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:14:03.804298 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:03.943095 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:03.976904 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1385f5c8-2a7a-45b1-a982-6f897700aa17', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '826848c6-a93a-4712-82dd-39e403bcb79e'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:14:03.980050 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-11a036e5-093d-4387-9e93-1d0851da5544" -d '{"events": [{"server_uuid": "1385f5c8-2a7a-45b1-a982-6f897700aa17", "name": "network-vif-plugged", "status": "completed", "tag": "826848c6-a93a-4712-82dd-39e403bcb79e"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:14:03.989649 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 826848c6-a93a-4712-82dd-39e403bcb79e, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=826848c6-a93a-4712-82dd-39e403bcb79e,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:14:03.994058 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:03.998079 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-119605c0-d1b2-4c53-9a4b-393844391656 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:04.062958 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:14:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-edb3d708-93dc-4b21-80c6-cd51fa425870 x-openstack-request-id: req-edb3d708-93dc-4b21-80c6-cd51fa425870 {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:14:04.062958 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1385f5c8-2a7a-45b1-a982-6f897700aa17", "name": "network-vif-plugged", "status": "completed", "tag": "826848c6-a93a-4712-82dd-39e403bcb79e", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:14:04.062958 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-edb3d708-93dc-4b21-80c6-cd51fa425870 {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:14:04.062958 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1385f5c8-2a7a-45b1-a982-6f897700aa17', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '826848c6-a93a-4712-82dd-39e403bcb79e', 'code': 200}
Jun 01 06:14:04.115246 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=826848c6-a93a-4712-82dd-39e403bcb79e,revision_number=7']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:04.130144 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:04.725682 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fe90c5c-b0ac-4629-bb46-6ed8f23e3482 req-ff3b0120-18ac-42b3-a6e3-4bc4ed3af1de tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:04.727153 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0fe90c5c-b0ac-4629-bb46-6ed8f23e3482 req-ff3b0120-18ac-42b3-a6e3-4bc4ed3af1de tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.0893071
Jun 01 06:14:04.845376 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0fe90c5c-b0ac-4629-bb46-6ed8f23e3482 req-ee399426-6fbe-49c9-bcff-7ea199049da2 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1104748
Jun 01 06:14:04.961703 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd3e99e-0f36-47c2-81c5-95aa12d96ff5 req-dc19bd40-b48e-44fa-8231-fc1704aedaec tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:04.963242 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4bd3e99e-0f36-47c2-81c5-95aa12d96ff5 req-dc19bd40-b48e-44fa-8231-fc1704aedaec tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 944 time: 0.0803473
Jun 01 06:14:05.010450 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4bd3e99e-0f36-47c2-81c5-95aa12d96ff5 req-8a9e70aa-629e-480e-bae5-68ad71f5fda0 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0416138
Jun 01 06:14:06.034524 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163dc8e6-722d-4be4-a708-7270714fc945 req-a804ddf3-14e6-434b-affe-76859f63a856 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:06.035944 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-163dc8e6-722d-4be4-a708-7270714fc945 req-a804ddf3-14e6-434b-affe-76859f63a856 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.0801518
Jun 01 06:14:06.085969 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-163dc8e6-722d-4be4-a708-7270714fc945 req-4b67a7f1-a5b5-4429-8e56-ae89c2e9567b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0437686
Jun 01 06:14:06.201689 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7b89b4b-c6fd-4c0f-aca4-2d7124cf08f0 req-dd42fe6a-92d6-4c7b-9c4c-9a1ed786e623 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:06.203126 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c7b89b4b-c6fd-4c0f-aca4-2d7124cf08f0 req-dd42fe6a-92d6-4c7b-9c4c-9a1ed786e623 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 944 time: 0.0824385
Jun 01 06:14:06.249226 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c7b89b4b-c6fd-4c0f-aca4-2d7124cf08f0 req-1d1bf49c-972b-4579-b467-e6e8362defea tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0402367
Jun 01 06:14:07.287765 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2800cc78-8f3b-43e0-a7c4-65ed32b43c46 req-1ccc68bb-e3fe-4c4b-a622-848a323e18ff tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:07.289250 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2800cc78-8f3b-43e0-a7c4-65ed32b43c46 req-1ccc68bb-e3fe-4c4b-a622-848a323e18ff tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.0849066
Jun 01 06:14:07.336119 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2800cc78-8f3b-43e0-a7c4-65ed32b43c46 req-e15710de-4e82-413a-affb-b2d878b2c285 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0412343
Jun 01 06:14:07.450073 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d9a49d1-882d-4385-a187-5a388a155319 req-ea8fa035-5f60-4c2f-8eac-5a170cd1fd99 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:07.451556 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1d9a49d1-882d-4385-a187-5a388a155319 req-ea8fa035-5f60-4c2f-8eac-5a170cd1fd99 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 944 time: 0.0896080
Jun 01 06:14:07.498950 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1d9a49d1-882d-4385-a187-5a388a155319 req-e1ab6c56-c4ed-4fd1-83f9-9e4749f75935 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0411644
Jun 01 06:14:08.326928 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b6953695-1304-4ffd-b977-f6c43f178091 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:08.538682 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6eb31a03-74f3-4d56-8955-d952d9a7a1b1 req-851e9339-6ddf-4850-a734-2db5a44c8269 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:08.541997 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6eb31a03-74f3-4d56-8955-d952d9a7a1b1 req-851e9339-6ddf-4850-a734-2db5a44c8269 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.0912576
Jun 01 06:14:08.601846 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6eb31a03-74f3-4d56-8955-d952d9a7a1b1 req-20e71e64-902e-42bb-89ad-618ec75f97e1 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0541902
Jun 01 06:14:08.702095 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dd775eb-5983-4609-84a7-bb53a26727e2 req-ffc70093-3d06-4001-b9a8-9dadb7834565 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:08.703539 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4dd775eb-5983-4609-84a7-bb53a26727e2 req-ffc70093-3d06-4001-b9a8-9dadb7834565 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 944 time: 0.0898840
Jun 01 06:14:08.749984 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4dd775eb-5983-4609-84a7-bb53a26727e2 req-54d7be1a-b80f-471c-bf37-9ae0beaef84e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0396497
Jun 01 06:14:09.796182 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9ac821-7dc8-4acd-94ef-3d9539eebe17 req-0933724a-e96a-4e69-9d98-eee13b1e1a7c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:09.797574 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5b9ac821-7dc8-4acd-94ef-3d9539eebe17 req-0933724a-e96a-4e69-9d98-eee13b1e1a7c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.0825529
Jun 01 06:14:09.848439 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5b9ac821-7dc8-4acd-94ef-3d9539eebe17 req-c3153146-860e-4439-a934-73a0e3fc7b1b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0444415
Jun 01 06:14:09.946790 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5498659d-6580-4bcb-beb4-a001acef347e req-0f029f50-4b5f-414c-bc94-887c0c9641f4 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:09.949858 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5498659d-6580-4bcb-beb4-a001acef347e req-0f029f50-4b5f-414c-bc94-887c0c9641f4 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 944 time: 0.0942001
Jun 01 06:14:09.996977 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5498659d-6580-4bcb-beb4-a001acef347e req-2655b60f-6068-4ba3-b175-8266e60e3be6 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0402079
Jun 01 06:14:11.079540 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca2bee8-452e-4e51-ae6d-0a8135766b2b req-e1a7169f-fac9-4a2e-baab-1dee6a792d89 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:11.081398 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3ca2bee8-452e-4e51-ae6d-0a8135766b2b req-e1a7169f-fac9-4a2e-baab-1dee6a792d89 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.1066778
Jun 01 06:14:11.155607 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3ca2bee8-452e-4e51-ae6d-0a8135766b2b req-462ca1be-c4fc-4f92-a845-eb0daa13ef23 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0627820
Jun 01 06:14:11.239152 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:11.252969 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e5d559b-1f30-49c5-a832-6b0f9d17eb7f req-cdd6196b-0d70-46c4-84a3-54c5a2b13185 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:11.263823 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6e5d559b-1f30-49c5-a832-6b0f9d17eb7f req-cdd6196b-0d70-46c4-84a3-54c5a2b13185 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 944 time: 0.1270902
Jun 01 06:14:11.318711 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6e5d559b-1f30-49c5-a832-6b0f9d17eb7f req-bad92eac-85ec-448e-9b3e-1a44e70965be tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0568557
Jun 01 06:14:11.771327 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 6c07ed73-1eed-4e63-90ca-60843e890090 details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:14:11.937670 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 6c07ed73-1eed-4e63-90ca-60843e890090, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=6c07ed73-1eed-4e63-90ca-60843e890090,segment=NetworkSegment(fd926c6b-9e42-4104-afe3-51ec344ecdd5),segment_id=fd926c6b-9e42-4104-afe3-51ec344ecdd5)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:14:11.956906 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': '6c07ed73-1eed-4e63-90ca-60843e890090', 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d', 'port_id': '6c07ed73-1eed-4e63-90ca-60843e890090', 'mac_address': 'fa:16:3e:21:61:09', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 222, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1fbcd64f-1378-4ec3-bd16-df65964c6028', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:14:12.039096 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:12.062867 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6c07ed73-1eed-4e63-90ca-60843e890090 {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:14:12.085510 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 6c07ed73-1eed-4e63-90ca-60843e890090, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=6c07ed73-1eed-4e63-90ca-60843e890090,segment=NetworkSegment(fd926c6b-9e42-4104-afe3-51ec344ecdd5),segment_id=fd926c6b-9e42-4104-afe3-51ec344ecdd5)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:14:12.097294 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:12.101652 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:12.240016 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=6c07ed73-1eed-4e63-90ca-60843e890090,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:12.243412 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:12.349252 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-60cef65c-48ce-4788-bf4f-38211852773e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:12.476583 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e08718fc-7882-480a-b7f4-de5e0616231a req-06484b3a-48b8-4c0b-a713-170dfcb54d5c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:12.479227 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e08718fc-7882-480a-b7f4-de5e0616231a req-06484b3a-48b8-4c0b-a713-170dfcb54d5c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.1146679
Jun 01 06:14:12.540236 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['6c07ed73-1eed-4e63-90ca-60843e890090'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:14:12.549536 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e08718fc-7882-480a-b7f4-de5e0616231a req-e4a582c4-4d16-402a-b946-7b857d51a3cd tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0559962
Jun 01 06:14:12.912242 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32507552-cc8e-4db8-9f7d-e05e5844f0a7 req-cd67d5ba-4868-458b-b388-316f53763c9e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:12.916750 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-32507552-cc8e-4db8-9f7d-e05e5844f0a7 req-cd67d5ba-4868-458b-b388-316f53763c9e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 945 time: 0.1578500
Jun 01 06:14:13.040329 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-32507552-cc8e-4db8-9f7d-e05e5844f0a7 req-ec1a503f-13d3-4e72-a51a-f420c11e25fb tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1123080
Jun 01 06:14:13.159160 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecfcf8ee-e3b9-4b0c-a223-33a106a16058 req-d0131baf-3719-478e-b7a6-aa6e20ab93b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:13.169572 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-ecfcf8ee-e3b9-4b0c-a223-33a106a16058 req-d0131baf-3719-478e-b7a6-aa6e20ab93b7 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=8f1cf739e243401eb5da7ee705e856de&device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 1098 time: 0.1724153
Jun 01 06:14:13.276867 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:13.280091 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7f76b07-f184-453d-bb83-4333f9a4f051 req-187d999d-3ba7-42e9-b341-94c813f360cb tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:13.281650 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e7f76b07-f184-453d-bb83-4333f9a4f051 req-187d999d-3ba7-42e9-b341-94c813f360cb tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1878669
Jun 01 06:14:13.373986 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e7f76b07-f184-453d-bb83-4333f9a4f051 req-e13dc315-f7e8-4ee8-b783-14d691e7fa7c tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0832410
Jun 01 06:14:13.445285 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecfcf8ee-e3b9-4b0c-a223-33a106a16058 req-c2cfb4f6-bd8c-4324-ac06-b37b2b7ffe98 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:13.446751 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-ecfcf8ee-e3b9-4b0c-a223-33a106a16058 req-c2cfb4f6-bd8c-4324-ac06-b37b2b7ffe98 service neutron] 10.222.0.48 "GET /v2.0/networks?id=6e45a0e5-f930-4b18-8f4f-1693815eb31a HTTP/1.1" status: 200  len: 919 time: 0.2646861
Jun 01 06:14:13.536933 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-ecfcf8ee-e3b9-4b0c-a223-33a106a16058 req-5aa8688e-93cd-4dcf-a7ba-c142bf3704e5 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5f320f89-ada2-472d-b9ac-0676b4c4b578 HTTP/1.1" status: 200  len: 217 time: 0.0803652
Jun 01 06:14:13.624629 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecfcf8ee-e3b9-4b0c-a223-33a106a16058 req-21a7c78c-ed56-4943-8beb-ed3fa2059540 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:13.626604 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-ecfcf8ee-e3b9-4b0c-a223-33a106a16058 req-21a7c78c-ed56-4943-8beb-ed3fa2059540 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=84c296fc-69c0-46e2-b1ed-e3edf435b759 HTTP/1.1" status: 200  len: 858 time: 0.0820930
Jun 01 06:14:13.699631 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-ecfcf8ee-e3b9-4b0c-a223-33a106a16058 req-3bcdd364-d5e2-43e8-b089-779ef096e043 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=6e45a0e5-f930-4b18-8f4f-1693815eb31a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0613441
Jun 01 06:14:13.860537 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a219661-a173-466d-a05f-f51a3073fd4c req-411543c9-a8c2-4e0e-8bbd-be9ed06d8b3c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:13.862029 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6a219661-a173-466d-a05f-f51a3073fd4c req-411543c9-a8c2-4e0e-8bbd-be9ed06d8b3c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.1361892
Jun 01 06:14:13.928304 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-ecfcf8ee-e3b9-4b0c-a223-33a106a16058 req-df5a9c63-a99d-4aa8-a6f9-135481e7a4cd service neutron] 10.222.0.48 "GET /v2.0/networks/6e45a0e5-f930-4b18-8f4f-1693815eb31a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2106104
Jun 01 06:14:13.934032 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6a219661-a173-466d-a05f-f51a3073fd4c req-e0b4a79e-ca2e-4b7a-96cc-7ed1a8d54257 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0637794
Jun 01 06:14:14.251813 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-ecfcf8ee-e3b9-4b0c-a223-33a106a16058 req-5e68937f-2467-40ba-8d45-12174dc53e5c service neutron] 10.222.0.48 "GET /v2.0/networks/6e45a0e5-f930-4b18-8f4f-1693815eb31a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3122022
Jun 01 06:14:14.365850 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e114b620-d329-4d16-a068-880d031514a8 req-5be3bb23-ff13-488b-ac1f-562bf0b9440f tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:14.373871 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e114b620-d329-4d16-a068-880d031514a8 req-5be3bb23-ff13-488b-ac1f-562bf0b9440f tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 945 time: 0.1780858
Jun 01 06:14:14.436146 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e114b620-d329-4d16-a068-880d031514a8 req-eee6193f-cbed-4255-b160-36c6b9e1754f tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0609810
Jun 01 06:14:14.541644 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e63beb6-3814-4a26-9bfb-e4daf7fe92dc req-8c4a3508-cd64-4ff9-95e2-6a2ce633c6b4 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:14.543806 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3e63beb6-3814-4a26-9bfb-e4daf7fe92dc req-8c4a3508-cd64-4ff9-95e2-6a2ce633c6b4 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=d96f81cf-f6ef-481f-bebb-b48820741532 HTTP/1.1" status: 200  len: 945 time: 0.0993044
Jun 01 06:14:14.671111 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3e63beb6-3814-4a26-9bfb-e4daf7fe92dc req-1e2896a0-8235-4a75-8908-18f1e4dbee57 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0931151
Jun 01 06:14:14.706373 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd90631e-1746-47a1-88b1-a7d0e1e4c615 req-4c7c08eb-12b5-4f64-8158-9aa9544e141c tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:14.708955 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-dd90631e-1746-47a1-88b1-a7d0e1e4c615 req-4c7c08eb-12b5-4f64-8158-9aa9544e141c tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1632631
Jun 01 06:14:14.768808 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-dd90631e-1746-47a1-88b1-a7d0e1e4c615 req-4e32e63f-607f-441b-a8b4-974d26235b3a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0546968
Jun 01 06:14:15.354567 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:15.362094 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a69e3f47-cbd3-43ab-9d87-7a02cc519404 req-bd6736d1-fe71-4206-9c20-c2dbfc2365d9 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:15.363612 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a69e3f47-cbd3-43ab-9d87-7a02cc519404 req-bd6736d1-fe71-4206-9c20-c2dbfc2365d9 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.1691868
Jun 01 06:14:15.419918 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a69e3f47-cbd3-43ab-9d87-7a02cc519404 req-3ebc14b2-89ca-450d-8957-8fbdd40fcff1 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0482881
Jun 01 06:14:15.649862 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76ca88a6-a4f3-48c7-aa81-b297c56db307 req-fccc825e-bd29-41e0-84da-26b46df3ef12 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:15.653086 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-76ca88a6-a4f3-48c7-aa81-b297c56db307 req-fccc825e-bd29-41e0-84da-26b46df3ef12 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 945 time: 0.0955045
Jun 01 06:14:15.773040 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-76ca88a6-a4f3-48c7-aa81-b297c56db307 req-a67cee04-95be-446e-a557-2fa7b9ffca2d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1099272
Jun 01 06:14:15.787722 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 6c07ed73-1eed-4e63-90ca-60843e890090 up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:14:15.945450 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning for port 6c07ed73-1eed-4e63-90ca-60843e890090 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:14:15.970879 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port 6c07ed73-1eed-4e63-90ca-60843e890090 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:14:15.971272 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:16.044221 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:16.103302 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-123a4c4b-d148-4c73-947b-004ce1cacda3 req-e772d71e-4cf6-4874-8b13-defd75f30820 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:16.111886 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-123a4c4b-d148-4c73-947b-004ce1cacda3 req-e772d71e-4cf6-4874-8b13-defd75f30820 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=d96f81cf-f6ef-481f-bebb-b48820741532 HTTP/1.1" status: 200  len: 945 time: 0.2401733
Jun 01 06:14:16.136926 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:16.164016 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8b9a592-1ac0-455b-9186-252118d98a8f req-cfc1f74a-b09b-40f6-9a6e-88bce7b64ac1 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:16.165548 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d8b9a592-1ac0-455b-9186-252118d98a8f req-cfc1f74a-b09b-40f6-9a6e-88bce7b64ac1 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.2139342
Jun 01 06:14:16.176017 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-123a4c4b-d148-4c73-947b-004ce1cacda3 req-8c10d438-a467-457e-b4fb-b93877345cb3 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0632184
Jun 01 06:14:16.177391 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a8503e6f-cd18-456e-9b8d-c60b093a7c7f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6c07ed73-1eed-4e63-90ca-60843e890090'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:14:16.180590 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f18dc4ff-adb0-41f1-bc5c-99677c258790" -d '{"events": [{"server_uuid": "a8503e6f-cd18-456e-9b8d-c60b093a7c7f", "name": "network-vif-plugged", "status": "completed", "tag": "6c07ed73-1eed-4e63-90ca-60843e890090"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:14:16.193105 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 6c07ed73-1eed-4e63-90ca-60843e890090, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=6c07ed73-1eed-4e63-90ca-60843e890090,segment=NetworkSegment(fd926c6b-9e42-4104-afe3-51ec344ecdd5),segment_id=fd926c6b-9e42-4104-afe3-51ec344ecdd5)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:14:16.208429 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:16.211699 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-a9f25f3e-a1ff-4764-9a44-b4d41bbeb628 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:16.262176 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:14:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-771997e3-4266-4910-a79b-f9fb9f1e57d9 x-openstack-request-id: req-771997e3-4266-4910-a79b-f9fb9f1e57d9 {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:14:16.262871 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a8503e6f-cd18-456e-9b8d-c60b093a7c7f", "name": "network-vif-plugged", "status": "completed", "tag": "6c07ed73-1eed-4e63-90ca-60843e890090", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:14:16.263350 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-771997e3-4266-4910-a79b-f9fb9f1e57d9 {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:14:16.263987 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d8b9a592-1ac0-455b-9186-252118d98a8f req-f573f244-1659-4929-8c45-f786bf1bc4e1 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0831249
Jun 01 06:14:16.264253 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a8503e6f-cd18-456e-9b8d-c60b093a7c7f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6c07ed73-1eed-4e63-90ca-60843e890090', 'code': 200}
Jun 01 06:14:16.306746 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=6c07ed73-1eed-4e63-90ca-60843e890090,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:16.313017 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:16.682629 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0251de86-8335-4189-a9d5-1ac25c0341a1 req-8fde2ca4-0d4e-452f-9b7b-4fa1a18f1277 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:16.684971 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0251de86-8335-4189-a9d5-1ac25c0341a1 req-8fde2ca4-0d4e-452f-9b7b-4fa1a18f1277 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.1162648
Jun 01 06:14:16.696356 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-451b2581-7cc5-4ed8-bfa8-d9e5b47173dd req-559b6913-7711-4759-a993-2324075ce384 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:16.699391 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-451b2581-7cc5-4ed8-bfa8-d9e5b47173dd req-559b6913-7711-4759-a993-2324075ce384 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 1099 time: 0.1147873
Jun 01 06:14:16.738864 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0251de86-8335-4189-a9d5-1ac25c0341a1 req-b158da1e-ada2-4510-8412-23b1dcf0ea56 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0477307
Jun 01 06:14:16.751897 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-451b2581-7cc5-4ed8-bfa8-d9e5b47173dd req-4cda524f-0559-4bf2-9822-1175f9dadf88 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0448120
Jun 01 06:14:16.999865 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19fd9246-d024-4e72-b5a9-f5c34a785ac8 req-a27a2908-38bf-440e-b7c8-e20a6df9a3ac tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:17.001350 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-19fd9246-d024-4e72-b5a9-f5c34a785ac8 req-a27a2908-38bf-440e-b7c8-e20a6df9a3ac tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 946 time: 0.1062515
Jun 01 06:14:17.022074 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4608c203-0d23-4514-8efb-adfeb60346cb req-18915e33-7a74-43fc-9ff4-8d0d01178fb9 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:17.031134 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-4608c203-0d23-4514-8efb-adfeb60346cb req-18915e33-7a74-43fc-9ff4-8d0d01178fb9 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.48 "GET /v2.0/ports?device_id=d96f81cf-f6ef-481f-bebb-b48820741532 HTTP/1.1" status: 200  len: 945 time: 0.1630361
Jun 01 06:14:17.087431 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-19fd9246-d024-4e72-b5a9-f5c34a785ac8 req-85cad043-cf03-46cb-924a-35e95bfb81ed tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0789158
Jun 01 06:14:17.204292 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [req-4608c203-0d23-4514-8efb-adfeb60346cb req-c6098c46-b888-410b-b59c-ff879b293c22 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Deleting port c6e37ad6-d047-468d-9d98-820e15a7165b {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:14:17.204952 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-4608c203-0d23-4514-8efb-adfeb60346cb req-c6098c46-b888-410b-b59c-ff879b293c22 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:17.385666 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [req-4608c203-0d23-4514-8efb-adfeb60346cb req-c6098c46-b888-410b-b59c-ff879b293c22 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] For port c6e37ad6-d047-468d-9d98-820e15a7165b, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=c6e37ad6-d047-468d-9d98-820e15a7165b,segment=NetworkSegment(7e12089c-d8cc-429c-8b7b-f5d148a55957),segment_id=7e12089c-d8cc-429c-8b7b-f5d148a55957)] {{(pid=92230) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:14:17.387768 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-4608c203-0d23-4514-8efb-adfeb60346cb req-c6098c46-b888-410b-b59c-ff879b293c22 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:17.490905 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-663ce95f-163b-48c3-93d7-396b0cdb12e2 req-b4b3ca61-f3ee-46f2-b978-fbbdd06e0da8 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:17.492504 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-663ce95f-163b-48c3-93d7-396b0cdb12e2 req-b4b3ca61-f3ee-46f2-b978-fbbdd06e0da8 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=d96f81cf-f6ef-481f-bebb-b48820741532 HTTP/1.1" status: 200  len: 945 time: 0.1810858
Jun 01 06:14:17.540914 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c46d0aa1-5066-4dd8-8595-7303dd23db1b req-dd2ed937-24a5-4a21-b4f8-93673eac11be tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:17.542912 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c46d0aa1-5066-4dd8-8595-7303dd23db1b req-dd2ed937-24a5-4a21-b4f8-93673eac11be tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1425068
Jun 01 06:14:17.552518 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [req-4608c203-0d23-4514-8efb-adfeb60346cb req-c6098c46-b888-410b-b59c-ff879b293c22 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Calling delete_port for c6e37ad6-d047-468d-9d98-820e15a7165b owned by compute:nova {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:14:17.585367 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-663ce95f-163b-48c3-93d7-396b0cdb12e2 req-11d63f18-61b8-44e1-bd04-2f79d97c0109 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0858350
Jun 01 06:14:17.628251 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c46d0aa1-5066-4dd8-8595-7303dd23db1b req-e9ec8f8d-1f0b-4e89-a610-8927d95374a7 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0736680
Jun 01 06:14:17.754433 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-4608c203-0d23-4514-8efb-adfeb60346cb req-c6098c46-b888-410b-b59c-ff879b293c22 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:17.760813 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:17.771423 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['de8f02a4-b74f-47df-a797-bc3cbe7be366', 'b83de976-8a2a-4caf-b3a4-4f2d2016ddd4', '690a6f90-fdb6-46f4-8f05-03e0ab827f78', 'c6e37ad6-d047-468d-9d98-820e15a7165b'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:14:17.811473 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6098c46-b888-410b-b59c-ff879b293c22 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Pushing event deleted for resources: {'Port': ['ID=c6e37ad6-d047-468d-9d98-820e15a7165b,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:17.825277 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-c6098c46-b888-410b-b59c-ff879b293c22 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:17.937432 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [req-4608c203-0d23-4514-8efb-adfeb60346cb req-c6098c46-b888-410b-b59c-ff879b293c22 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] No DVR routers for this DVR port c6e37ad6-d047-468d-9d98-820e15a7165b on host hv-cinder-79388 {{(pid=92230) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:14:17.940539 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-4608c203-0d23-4514-8efb-adfeb60346cb req-c6098c46-b888-410b-b59c-ff879b293c22 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:17.943142 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd96f81cf-f6ef-481f-bebb-b48820741532', 'name': 'network-vif-deleted', 'tag': 'c6e37ad6-d047-468d-9d98-820e15a7165b'}] {{(pid=92230) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:14:17.945457 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a8971187fdc179bafebfda031591b22633150c3ea1d9449252a7819502f19756" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9f1707d0-1fe3-46fe-8156-9067539b5821" -d '{"events": [{"server_uuid": "d96f81cf-f6ef-481f-bebb-b48820741532", "name": "network-vif-deleted", "tag": "c6e37ad6-d047-468d-9d98-820e15a7165b"}]}' {{(pid=92230) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:14:17.962457 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5774d611-c1ae-4511-80b1-38cb130cf340 req-72068833-f553-46fd-93e7-f6421183664d tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:17.964748 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5774d611-c1ae-4511-80b1-38cb130cf340 req-72068833-f553-46fd-93e7-f6421183664d tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.0990756
Jun 01 06:14:17.966238 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-4608c203-0d23-4514-8efb-adfeb60346cb req-c6098c46-b888-410b-b59c-ff879b293c22 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.48 "DELETE /v2.0/ports/c6e37ad6-d047-468d-9d98-820e15a7165b HTTP/1.1" status: 204  len: 173 time: 0.9266441
Jun 01 06:14:18.006190 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:14:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d40bc98c-7502-4356-af85-d0574c6cd20c x-openstack-request-id: req-d40bc98c-7502-4356-af85-d0574c6cd20c {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:14:18.006621 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d96f81cf-f6ef-481f-bebb-b48820741532", "name": "network-vif-deleted", "tag": "c6e37ad6-d047-468d-9d98-820e15a7165b", "status": "completed", "code": 200}]} {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:14:18.006963 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-d40bc98c-7502-4356-af85-d0574c6cd20c {{(pid=92230) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:14:18.007483 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd96f81cf-f6ef-481f-bebb-b48820741532', 'name': 'network-vif-deleted', 'tag': 'c6e37ad6-d047-468d-9d98-820e15a7165b', 'status': 'completed', 'code': 200}
Jun 01 06:14:18.023393 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5774d611-c1ae-4511-80b1-38cb130cf340 req-3aa4aa13-033a-425a-bf87-4bc8efeea510 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0523238
Jun 01 06:14:18.325471 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc446dad-b4f6-4869-815a-d712137d01f0 req-5548e097-5fa0-447b-8848-43803451a588 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:18.327254 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fc446dad-b4f6-4869-815a-d712137d01f0 req-5548e097-5fa0-447b-8848-43803451a588 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 946 time: 0.0987804
Jun 01 06:14:18.378642 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fc446dad-b4f6-4869-815a-d712137d01f0 req-ee7dc417-eda5-45c0-b3e8-f794b0291d33 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0451035
Jun 01 06:14:18.776058 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e4e6c1ed-46a0-4e3e-8d47-f60cd967dc8d req-4fc2ad71-3c99-44be-b0ec-efe91621d287 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=d96f81cf-f6ef-481f-bebb-b48820741532 HTTP/1.1" status: 200  len: 210 time: 0.0458169
Jun 01 06:14:18.879143 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-378780c3-5edf-4af9-9e05-60cd133faa47 req-8fec4bc1-1552-4cc3-aa12-ae80abd243ca tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:18.886834 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-378780c3-5edf-4af9-9e05-60cd133faa47 req-8fec4bc1-1552-4cc3-aa12-ae80abd243ca tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1086130
Jun 01 06:14:18.977103 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-378780c3-5edf-4af9-9e05-60cd133faa47 req-fbb13168-2cdc-4747-aab1-e2ea25911ebc tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0881801
Jun 01 06:14:19.305860 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1159f1e1-1a21-45ea-ba0c-0d9ab32d0e3a req-b76c59e8-d4d9-4e2d-b920-69167ef23d49 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:19.307512 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1159f1e1-1a21-45ea-ba0c-0d9ab32d0e3a req-b76c59e8-d4d9-4e2d-b920-69167ef23d49 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.0973608
Jun 01 06:14:19.369786 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1159f1e1-1a21-45ea-ba0c-0d9ab32d0e3a req-5b6b0bc1-2472-48c1-86cd-722446b237bb tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0516026
Jun 01 06:14:19.608529 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32dfa396-cfea-42e0-bda7-8241847d1ab6 req-586613a1-07c0-4381-ac5c-b977929c0489 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:19.612534 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-32dfa396-cfea-42e0-bda7-8241847d1ab6 req-586613a1-07c0-4381-ac5c-b977929c0489 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 946 time: 0.1097584
Jun 01 06:14:19.662951 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-32dfa396-cfea-42e0-bda7-8241847d1ab6 req-99458257-4369-4d11-830e-150de6cc47af tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0472856
Jun 01 06:14:19.805744 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device c6e37ad6-d047-468d-9d98-820e15a7165b no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:14:19.875161 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af9cff0d-941b-4e97-87ca-346f761455cb req-06125e80-2b41-4f74-a500-e0b5b46f8fc0 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:19.876902 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-af9cff0d-941b-4e97-87ca-346f761455cb req-06125e80-2b41-4f74-a500-e0b5b46f8fc0 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 946 time: 0.0997388
Jun 01 06:14:19.897648 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] No Port match for: c6e37ad6-d047-468d-9d98-820e15a7165b {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:14:19.898058 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device c6e37ad6-d047-468d-9d98-820e15a7165b not bound to the agent host hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:14:19.943655 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-af9cff0d-941b-4e97-87ca-346f761455cb req-f0654a6d-10a0-462f-959d-ffeef78619da tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0557523
Jun 01 06:14:19.959600 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 35468) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:14:20.275543 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4db902e2-adea-4a9b-988d-188d45174189 req-dad7781c-6402-4d52-b079-cfeaf85a7fa4 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:20.277973 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4db902e2-adea-4a9b-988d-188d45174189 req-dad7781c-6402-4d52-b079-cfeaf85a7fa4 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1734598
Jun 01 06:14:20.431192 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4db902e2-adea-4a9b-988d-188d45174189 req-e13d1a9a-362f-460d-990f-f29ed8533b5d tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1365261
Jun 01 06:14:20.478097 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-31359055-af7b-42cd-b134-3a3e85b94a27 tempest-TestShelveInstance-1680998987 tempest-TestShelveInstance-1680998987-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:20.483414 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-31359055-af7b-42cd-b134-3a3e85b94a27 tempest-TestShelveInstance-1680998987 tempest-TestShelveInstance-1680998987-project-admin] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 1094 time: 0.5218539
Jun 01 06:14:20.486225 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 35490) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:14:20.493359 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Request body: {'floatingip': {'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'port_id': '6c07ed73-1eed-4e63-90ca-60843e890090', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'fixed_ip_address': '172.20.0.11'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:14:20.507818 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:14:20.518061 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Usage tracker for resource:floatingip and tenant:60be617f683c42a081ab3f50c3bdf8f1 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:14:20.522773 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:14:20.536878 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:14:20.561383 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for floatingip, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:20.685737 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-e04942a6-706c-4456-9713-8dcd7c92468f req-8d02eb8f-4709-4bc9-9117-784c6b4f76fb tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Synchronizing usage tracker for tenant:e8bcff3fed924886a68a8562a9f4f8f3 on resource:security_group {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:14:20.731018 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4ff6ae7-6e44-4e4a-9fe5-feada261c40d req-1eddaa94-e60b-467c-ad93-80fd50cb004f tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:20.732962 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b4ff6ae7-6e44-4e4a-9fe5-feada261c40d req-1eddaa94-e60b-467c-ad93-80fd50cb004f tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.1887822
Jun 01 06:14:20.734229 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-e04942a6-706c-4456-9713-8dcd7c92468f req-8d02eb8f-4709-4bc9-9117-784c6b4f76fb tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Unset dirty status for tenant:e8bcff3fed924886a68a8562a9f4f8f3 on resource:security_group {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:14:20.735411 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e04942a6-706c-4456-9713-8dcd7c92468f req-8d02eb8f-4709-4bc9-9117-784c6b4f76fb tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1032536289&fields=id&tenant_id=e8bcff3fed924886a68a8562a9f4f8f3 HTTP/1.1" status: 200  len: 267 time: 0.1047683
Jun 01 06:14:20.756141 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:20.951755 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_common [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Allocated IP 172.27.2.215 (83b812fb-2cfc-46e4-baa4-745218ea3ed2/a59d7d11-a92c-4b4f-83cf-2095ecee2b51/cd749d9c-9a1b-4d38-a1a9-d0bcde1eb7a1) {{(pid=92230) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:14:21.001992 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b4ff6ae7-6e44-4e4a-9fe5-feada261c40d req-d56a6008-6aa2-4a41-a508-fb75b7b1059e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2630241
Jun 01 06:14:21.010305 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e04942a6-706c-4456-9713-8dcd7c92468f req-dc665f6a-cffb-4633-84f3-00e7457d0e01 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:21.011833 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e04942a6-706c-4456-9713-8dcd7c92468f req-dc665f6a-cffb-4633-84f3-00e7457d0e01 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/networks?id=028fef0a-f05a-48d5-ba5c-b539846209ba HTTP/1.1" status: 200  len: 811 time: 0.2496960
Jun 01 06:14:21.039257 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e04942a6-706c-4456-9713-8dcd7c92468f req-f05d2dfd-c344-460f-b5bf-e5e662200b90 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/quotas/e8bcff3fed924886a68a8562a9f4f8f3 HTTP/1.1" status: 200  len: 375 time: 0.0205195
Jun 01 06:14:21.139067 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-e04942a6-706c-4456-9713-8dcd7c92468f req-00d84b46-0a52-48d8-b307-1ed2fe27ad58 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Synchronizing usage tracker for tenant:e8bcff3fed924886a68a8562a9f4f8f3 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:14:21.140932 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for port, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:21.159443 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-e04942a6-706c-4456-9713-8dcd7c92468f req-00d84b46-0a52-48d8-b307-1ed2fe27ad58 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Unset dirty status for tenant:e8bcff3fed924886a68a8562a9f4f8f3 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:14:21.161032 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e04942a6-706c-4456-9713-8dcd7c92468f req-00d84b46-0a52-48d8-b307-1ed2fe27ad58 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=e8bcff3fed924886a68a8562a9f4f8f3&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1207790
Jun 01 06:14:21.189132 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:21.193934 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:21.276195 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:14:21.281103 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:14:21.288486 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Received port after_create {{(pid=92230) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:14:21.367014 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e04942a6-706c-4456-9713-8dcd7c92468f req-f0ccd7dc-bdd6-4446-b1b7-ce86c59354bb service neutron] 10.222.0.25 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1934016
Jun 01 06:14:21.416260 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Pushing event updated for resources: {'Port': ['ID=cd749d9c-9a1b-4d38-a1a9-d0bcde1eb7a1,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:21.429210 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.235s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:21.717967 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e04942a6-706c-4456-9713-8dcd7c92468f req-6b2f5e5b-29e4-43b2-b56b-925fa7d437b5 service neutron] 10.222.0.25 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3437366
Jun 01 06:14:21.956694 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37e53c27-6207-494b-b864-d6db8088b52c req-162df709-06cd-414a-8fc8-2ecacd31695a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:21.966088 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-37e53c27-6207-494b-b864-d6db8088b52c req-162df709-06cd-414a-8fc8-2ecacd31695a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1113741
Jun 01 06:14:22.003024 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:22.028435 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-37e53c27-6207-494b-b864-d6db8088b52c req-f6273fcb-715f-437e-a2e0-9b9613187bb8 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0613654
Jun 01 06:14:22.156142 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:22.300922 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3ffddbb-06ed-4c3b-9924-100180fc6bb9 req-1a9f55ba-6705-425d-9845-773ed2f57e97 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:22.309099 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a3ffddbb-06ed-4c3b-9924-100180fc6bb9 req-1a9f55ba-6705-425d-9845-773ed2f57e97 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=601c5188-c17f-47a6-83cf-a69b68517e08 HTTP/1.1" status: 200  len: 945 time: 0.1657889
Jun 01 06:14:22.394516 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a3ffddbb-06ed-4c3b-9924-100180fc6bb9 req-8622576f-e8ae-49fc-8fca-9b23cad0352d tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0788419
Jun 01 06:14:22.552224 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for port, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:22.561386 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2416196'] for port, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:22.579756 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b19eaa2b-1dde-44ed-9ddf-8a00ac73a040 req-5b54b49c-9bf5-4ef5-ba19-027a0c931bf3 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 210 time: 0.1341522
Jun 01 06:14:22.593129 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:22.649177 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-396a94ff-a58a-47dd-80f8-b1e7560fecac req-ae38eb44-abf8-47d7-905b-a93fc57e0b5b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:22.651104 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-396a94ff-a58a-47dd-80f8-b1e7560fecac req-ae38eb44-abf8-47d7-905b-a93fc57e0b5b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.1595037
Jun 01 06:14:22.723830 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Pushing event updated for resources: {'Port': ['ID=cd749d9c-9a1b-4d38-a1a9-d0bcde1eb7a1,revision_number=2']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:22.741014 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:22.747284 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-745720'] for floatingip, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:22.750093 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-396a94ff-a58a-47dd-80f8-b1e7560fecac req-034eacb1-6e21-44cb-9f79-6b95777f73ea tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0847886
Jun 01 06:14:22.966583 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.db.l3_db [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Floating IP 5ed9ba98-8f9b-451e-b481-f30502ca4a26 associated. External IP: 172.27.2.215, port: 6c07ed73-1eed-4e63-90ca-60843e890090.
Jun 01 06:14:23.282665 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf8b814c-9fd2-42d0-adc4-32542a722d41 req-3644e7c0-1f96-4208-adfe-385921b85cbb tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:23.285405 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cf8b814c-9fd2-42d0-adc4-32542a722d41 req-3644e7c0-1f96-4208-adfe-385921b85cbb tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1255963
Jun 01 06:14:23.394125 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cf8b814c-9fd2-42d0-adc4-32542a722d41 req-bbafa6f4-566c-4af1-b434-62d6bd621a05 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0991895
Jun 01 06:14:23.484096 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Router 4b10a529-195d-4706-87d3-f422588c7516 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92230) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:14:23.646952 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fe4e44e-7147-4c83-b41b-8081334a4bdd req-3a130946-1eb2-41e0-9041-e25669a0d23b tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:23.648567 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2fe4e44e-7147-4c83-b41b-8081334a4bdd req-3a130946-1eb2-41e0-9041-e25669a0d23b tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=601c5188-c17f-47a6-83cf-a69b68517e08 HTTP/1.1" status: 200  len: 945 time: 0.1127856
Jun 01 06:14:23.702822 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2fe4e44e-7147-4c83-b41b-8081334a4bdd req-fb61ae04-b2fa-4b07-9baa-6b7da29b7088 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0473115
Jun 01 06:14:23.757828 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d00bb7dd-78b6-4375-8734-7b265bbc672b req-f3172058-03d2-4d3b-81ef-7fab2b2bcd3f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 210 time: 0.0583446
Jun 01 06:14:23.856841 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:14:23.867054 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-100c54e7-5cd7-41ff-904a-373a5524117d None None] Sync routers for ids ['4b10a529-195d-4706-87d3-f422588c7516'] in dv-cinder-793885-1-iscsi {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:14:23.881298 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-100c54e7-5cd7-41ff-904a-373a5524117d None None] Routers {'4b10a529-195d-4706-87d3-f422588c7516'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:14:23.881954 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-100c54e7-5cd7-41ff-904a-373a5524117d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b28f4cd0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:14:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['4b10a529-195d-4706-87d3-f422588c7516'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:14:23.930347 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for floatingip, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:24.053868 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 3.5663779
Jun 01 06:14:24.123596 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a8503e6f-cd18-456e-9b8d-c60b093a7c7f', 'tag': '6c07ed73-1eed-4e63-90ca-60843e890090'}] {{(pid=92230) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:14:24.127427 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e6d8197-17b9-452b-bf51-b437db31fc78 req-3a788556-7821-41b7-8c02-178ac770fe92 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:24.134651 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8e6d8197-17b9-452b-bf51-b437db31fc78 req-3a788556-7821-41b7-8c02-178ac770fe92 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.1860392
Jun 01 06:14:24.138234 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a8971187fdc179bafebfda031591b22633150c3ea1d9449252a7819502f19756" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2257c372-838e-4047-8962-c85fb814d057" -d '{"events": [{"name": "network-changed", "server_uuid": "a8503e6f-cd18-456e-9b8d-c60b093a7c7f", "tag": "6c07ed73-1eed-4e63-90ca-60843e890090"}]}' {{(pid=92230) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:14:24.144530 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-100c54e7-5cd7-41ff-904a-373a5524117d None None] Set router 4b10a529-195d-4706-87d3-f422588c7516 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:14:24.250802 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:14:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f47e801d-5812-4ffa-b78a-38848a02d8ec x-openstack-request-id: req-f47e801d-5812-4ffa-b78a-38848a02d8ec {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:14:24.251531 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a8503e6f-cd18-456e-9b8d-c60b093a7c7f", "tag": "6c07ed73-1eed-4e63-90ca-60843e890090", "status": "completed", "code": 200}]} {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:14:24.254556 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-f47e801d-5812-4ffa-b78a-38848a02d8ec {{(pid=92230) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:14:24.255128 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a8503e6f-cd18-456e-9b8d-c60b093a7c7f', 'tag': '6c07ed73-1eed-4e63-90ca-60843e890090', 'status': 'completed', 'code': 200}
Jun 01 06:14:24.274188 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22bbc7c5-1593-4896-b012-b2f94d770568 req-d5cf708b-96e4-477a-ad21-b64bac8f5dc1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:24.275044 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-22bbc7c5-1593-4896-b012-b2f94d770568 req-d5cf708b-96e4-477a-ad21-b64bac8f5dc1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Synchronizing usage tracker for tenant:b02068c8f29e4f5e9b3c965d023f7e29 on resource:port {{(pid=92230) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:14:24.312718 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-22bbc7c5-1593-4896-b012-b2f94d770568 req-d5cf708b-96e4-477a-ad21-b64bac8f5dc1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Unset dirty status for tenant:b02068c8f29e4f5e9b3c965d023f7e29 on resource:port {{(pid=92230) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:14:24.314344 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-22bbc7c5-1593-4896-b012-b2f94d770568 req-d5cf708b-96e4-477a-ad21-b64bac8f5dc1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.48 "GET /v2.0/ports?device_id=601c5188-c17f-47a6-83cf-a69b68517e08 HTTP/1.1" status: 200  len: 945 time: 0.2625008
Jun 01 06:14:24.435905 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8e6d8197-17b9-452b-bf51-b437db31fc78 req-dee5dfe4-d755-44e5-afff-4a28a1f560ae tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2961774
Jun 01 06:14:24.475182 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 35562) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:14:24.669726 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [req-22bbc7c5-1593-4896-b012-b2f94d770568 req-832e318f-8561-42d0-b189-40eba2d69318 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Deleting port 690a6f90-fdb6-46f4-8f05-03e0ab827f78 {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:14:24.670438 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-22bbc7c5-1593-4896-b012-b2f94d770568 req-832e318f-8561-42d0-b189-40eba2d69318 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:24.679675 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-100c54e7-5cd7-41ff-904a-373a5524117d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b28f4cd0>, [{'id': '4b10a529-195d-4706-87d3-f422588c7516', 'name': 'tempest-TestShelveInstance-1811865016-router', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74'}], 'enable_snat': True}, 'gw_port_id': '2ff74456-d8aa-477a-a634-aca56832439b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:06Z', 'updated_at': '2021-06-01T06:13:12Z', 'revision_number': 4, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'gw_port': {'id': '2ff74456-d8aa-477a-a634-aca56832439b', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:52:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b10a529-195d-4706-87d3-f422588c7516', 'device_owner': 'network:router_gateway', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:07Z', 'updated_at': '2021-06-01T06:13:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '5ed9ba98-8f9b-451e-b481-f30502ca4a26', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'floating_ip_address': '172.27.2.215', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': '4b10a529-195d-4706-87d3-f422588c7516', 'port_id': '6c07ed73-1eed-4e63-90ca-60843e890090', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 398, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d', 'mac_address': 'fa:16:3e:21:61:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a8503e6f-cd18-456e-9b8d-c60b093a7c7f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:14:21Z', 'updated_at': '2021-06-01T06:14:21Z', 'revision_number': 0, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9708fa96-563b-40e8-9c0f-8540e15e4126', 'name': '', 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'mac_address': 'fa:16:3e:06:43:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b10a529-195d-4706-87d3-f422588c7516', 'device_owner': 'network:router_interface', 'standard_attr_id': 315, 'fixed_ips': [{'subnet_id': '1fbcd64f-1378-4ec3-bd16-df65964c6028', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:11Z', 'updated_at': '2021-06-01T06:13:21Z', 'revision_number': 5, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'subnets': [{'id': '1fbcd64f-1378-4ec3-bd16-df65964c6028', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:14:24.695246 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-100c54e7-5cd7-41ff-904a-373a5524117d None None] Checking router: 4b10a529-195d-4706-87d3-f422588c7516 for host: dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:14:24.706642 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-100c54e7-5cd7-41ff-904a-373a5524117d None None] Routers {'4b10a529-195d-4706-87d3-f422588c7516'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:14:24.708371 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-100c54e7-5cd7-41ff-904a-373a5524117d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b28f4cd0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:14:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['4b10a529-195d-4706-87d3-f422588c7516'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:14:24.711401 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-14030fd4-6bf8-446d-a886-7ed3772b4b6c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:24.786324 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2257c372-838e-4047-8962-c85fb814d057 req-d9277432-4990-40ec-9d56-83bb25555f99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:24.788499 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2257c372-838e-4047-8962-c85fb814d057 req-d9277432-4990-40ec-9d56-83bb25555f99 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=60be617f683c42a081ab3f50c3bdf8f1&device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 1099 time: 0.4868872
Jun 01 06:14:24.856503 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e04942a6-706c-4456-9713-8dcd7c92468f req-477335e7-267e-494d-9ac7-dd4932d794d6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:24.863002 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e04942a6-706c-4456-9713-8dcd7c92468f req-477335e7-267e-494d-9ac7-dd4932d794d6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.48 "GET /v2.0/networks?id=028fef0a-f05a-48d5-ba5c-b539846209ba HTTP/1.1" status: 200  len: 811 time: 0.6522713
Jun 01 06:14:24.928749 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-100c54e7-5cd7-41ff-904a-373a5524117d None None] Set router 4b10a529-195d-4706-87d3-f422588c7516 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:14:24.991922 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [req-22bbc7c5-1593-4896-b012-b2f94d770568 req-832e318f-8561-42d0-b189-40eba2d69318 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] For port 690a6f90-fdb6-46f4-8f05-03e0ab827f78, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=690a6f90-fdb6-46f4-8f05-03e0ab827f78,segment=NetworkSegment(7e12089c-d8cc-429c-8b7b-f5d148a55957),segment_id=7e12089c-d8cc-429c-8b7b-f5d148a55957)] {{(pid=92230) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:14:24.992551 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-22bbc7c5-1593-4896-b012-b2f94d770568 req-832e318f-8561-42d0-b189-40eba2d69318 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:25.072416 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-14030fd4-6bf8-446d-a886-7ed3772b4b6c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:14:25.140321 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-14030fd4-6bf8-446d-a886-7ed3772b4b6c admin admin] Usage tracker for resource:security_group_rule and tenant:88787c6f3c934bdfb8967652d71d13b3 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:14:25.144254 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-14030fd4-6bf8-446d-a886-7ed3772b4b6c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:14:25.150869 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-14030fd4-6bf8-446d-a886-7ed3772b4b6c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:14:25.177335 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [req-22bbc7c5-1593-4896-b012-b2f94d770568 req-832e318f-8561-42d0-b189-40eba2d69318 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Calling delete_port for 690a6f90-fdb6-46f4-8f05-03e0ab827f78 owned by compute:nova {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:14:25.247857 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e04942a6-706c-4456-9713-8dcd7c92468f req-438188a7-fc74-4552-8b8b-5c3e9d7dd3cd tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.48 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=e8bcff3fed924886a68a8562a9f4f8f3 HTTP/1.1" status: 200  len: 380 time: 0.2920997
Jun 01 06:14:25.264140 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93b53197-07ba-4142-a261-897bc39638f1 req-6d46b88a-56ef-4b4d-b5ed-4bb7f5f30a71 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:25.271987 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-93b53197-07ba-4142-a261-897bc39638f1 req-6d46b88a-56ef-4b4d-b5ed-4bb7f5f30a71 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.6336145
Jun 01 06:14:25.281683 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-e04942a6-706c-4456-9713-8dcd7c92468f req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Request body: {'port': {'device_id': '09215815-8dd9-46e4-879a-7c3b58e35a54', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'admin_state_up': True, 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'security_groups': ['837b69a3-6811-4cdc-8ade-9ad4352f4196']}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:14:25.349847 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-14030fd4-6bf8-446d-a886-7ed3772b4b6c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:25.360561 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-14030fd4-6bf8-446d-a886-7ed3772b4b6c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:25.390235 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e031269b-5e5c-4748-a192-c293d8d3fc6e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:25.407072 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-14030fd4-6bf8-446d-a886-7ed3772b4b6c admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=88787c6f3c934bdfb8967652d71d13b3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9306760
Jun 01 06:14:25.407690 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 35582) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:14:25.438986 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59dff2c0-16ae-4e65-836f-a95f8535863f req-989c8e6b-ec26-4c5f-b482-fe47589e8744 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:25.444443 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-59dff2c0-16ae-4e65-836f-a95f8535863f req-989c8e6b-ec26-4c5f-b482-fe47589e8744 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=601c5188-c17f-47a6-83cf-a69b68517e08 HTTP/1.1" status: 200  len: 945 time: 0.4913483
Jun 01 06:14:25.485255 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14030fd4-6bf8-446d-a886-7ed3772b4b6c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=719855e1-7591-4edd-9372-07a39658bbae,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:25.487170 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-22bbc7c5-1593-4896-b012-b2f94d770568 req-832e318f-8561-42d0-b189-40eba2d69318 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:25.503126 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2257c372-838e-4047-8962-c85fb814d057 req-05d0da9d-6397-484d-90a3-f87f993e38ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:25.503514 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['de8f02a4-b74f-47df-a797-bc3cbe7be366', 'b83de976-8a2a-4caf-b3a4-4f2d2016ddd4', '690a6f90-fdb6-46f4-8f05-03e0ab827f78'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:14:25.505362 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-14030fd4-6bf8-446d-a886-7ed3772b4b6c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:25.506036 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2257c372-838e-4047-8962-c85fb814d057 req-05d0da9d-6397-484d-90a3-f87f993e38ab service neutron] 10.222.0.48 "GET /v2.0/networks?id=6200246e-b324-4384-a0a9-6dc6726e2c6d HTTP/1.1" status: 200  len: 910 time: 0.7029223
Jun 01 06:14:25.525228 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-93b53197-07ba-4142-a261-897bc39638f1 req-ec0e9163-eac9-49a1-bf3e-e719a4947dd6 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2522123
Jun 01 06:14:25.533727 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.031s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:25.591983 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-100c54e7-5cd7-41ff-904a-373a5524117d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b28f4cd0>, [{'id': '4b10a529-195d-4706-87d3-f422588c7516', 'name': 'tempest-TestShelveInstance-1811865016-router', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74'}], 'enable_snat': True}, 'gw_port_id': '2ff74456-d8aa-477a-a634-aca56832439b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:06Z', 'updated_at': '2021-06-01T06:13:12Z', 'revision_number': 4, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'gw_port': {'id': '2ff74456-d8aa-477a-a634-aca56832439b', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:52:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b10a529-195d-4706-87d3-f422588c7516', 'device_owner': 'network:router_gateway', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:07Z', 'updated_at': '2021-06-01T06:13:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '5ed9ba98-8f9b-451e-b481-f30502ca4a26', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'floating_ip_address': '172.27.2.215', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': '4b10a529-195d-4706-87d3-f422588c7516', 'port_id': '6c07ed73-1eed-4e63-90ca-60843e890090', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 398, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d', 'mac_address': 'fa:16:3e:21:61:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a8503e6f-cd18-456e-9b8d-c60b093a7c7f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:14:21Z', 'updated_at': '2021-06-01T06:14:21Z', 'revision_number': 0, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9708fa96-563b-40e8-9c0f-8540e15e4126', 'name': '', 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'mac_address': 'fa:16:3e:06:43:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b10a529-195d-4706-87d3-f422588c7516', 'device_owner': 'network:router_interface', 'standard_attr_id': 315, 'fixed_ips': [{'subnet_id': '1fbcd64f-1378-4ec3-bd16-df65964c6028', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:11Z', 'updated_at': '2021-06-01T06:13:21Z', 'revision_number': 5, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'subnets': [{'id': '1fbcd64f-1378-4ec3-bd16-df65964c6028', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:14:25.603734 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-100c54e7-5cd7-41ff-904a-373a5524117d None None] The sync data for ids ['4b10a529-195d-4706-87d3-f422588c7516'] in dv-cinder-793885-1-iscsi is: [{'id': '4b10a529-195d-4706-87d3-f422588c7516', 'name': 'tempest-TestShelveInstance-1811865016-router', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74'}], 'enable_snat': True}, 'gw_port_id': '2ff74456-d8aa-477a-a634-aca56832439b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:06Z', 'updated_at': '2021-06-01T06:13:12Z', 'revision_number': 4, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'gw_port': {'id': '2ff74456-d8aa-477a-a634-aca56832439b', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:52:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b10a529-195d-4706-87d3-f422588c7516', 'device_owner': 'network:router_gateway', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:07Z', 'updated_at': '2021-06-01T06:13:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '5ed9ba98-8f9b-451e-b481-f30502ca4a26', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'floating_ip_address': '172.27.2.215', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': '4b10a529-195d-4706-87d3-f422588c7516', 'port_id': '6c07ed73-1eed-4e63-90ca-60843e890090', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 398, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d', 'mac_address': 'fa:16:3e:21:61:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a8503e6f-cd18-456e-9b8d-c60b093a7c7f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:14:21Z', 'updated_at': '2021-06-01T06:14:21Z', 'revision_number': 0, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9708fa96-563b-40e8-9c0f-8540e15e4126', 'name': '', 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'mac_address': 'fa:16:3e:06:43:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b10a529-195d-4706-87d3-f422588c7516', 'device_owner': 'network:router_interface', 'standard_attr_id': 315, 'fixed_ips': [{'subnet_id': '1fbcd64f-1378-4ec3-bd16-df65964c6028', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:11Z', 'updated_at': '2021-06-01T06:13:21Z', 'revision_number': 5, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'subnets': [{'id': '1fbcd64f-1378-4ec3-bd16-df65964c6028', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:14:25.654093 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-832e318f-8561-42d0-b189-40eba2d69318 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Pushing event deleted for resources: {'Port': ['ID=690a6f90-fdb6-46f4-8f05-03e0ab827f78,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:25.676016 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-e04942a6-706c-4456-9713-8dcd7c92468f req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:14:25.717318 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-e04942a6-706c-4456-9713-8dcd7c92468f req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:14:25.728678 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-832e318f-8561-42d0-b189-40eba2d69318 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.195s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:25.731534 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-221edb6f-3243-4254-a7cd-44774403146a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:25.752892 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-59dff2c0-16ae-4e65-836f-a95f8535863f req-be33f946-d455-4f78-9d59-4f85440cd8bb tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2683451
Jun 01 06:14:25.784045 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [req-22bbc7c5-1593-4896-b012-b2f94d770568 req-832e318f-8561-42d0-b189-40eba2d69318 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] No DVR routers for this DVR port 690a6f90-fdb6-46f4-8f05-03e0ab827f78 on host hv-cinder-79388 {{(pid=92230) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:14:25.788663 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-22bbc7c5-1593-4896-b012-b2f94d770568 req-832e318f-8561-42d0-b189-40eba2d69318 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:25.796685 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2257c372-838e-4047-8962-c85fb814d057 req-eea08c20-9931-4a9a-996c-d03bd1590c7c service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=6c07ed73-1eed-4e63-90ca-60843e890090 HTTP/1.1" status: 200  len: 1000 time: 0.2680426
Jun 01 06:14:25.853828 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-221edb6f-3243-4254-a7cd-44774403146a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:25.872520 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e04942a6-706c-4456-9713-8dcd7c92468f req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Made reservation on behalf of e8bcff3fed924886a68a8562a9f4f8f3 for: {'port': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:14:25.876510 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e04942a6-706c-4456-9713-8dcd7c92468f req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:25.891206 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2257c372-838e-4047-8962-c85fb814d057 req-fb5cf007-72a4-4d9b-9fe4-34c967043654 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:25.893093 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2257c372-838e-4047-8962-c85fb814d057 req-fb5cf007-72a4-4d9b-9fe4-34c967043654 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=1fbcd64f-1378-4ec3-bd16-df65964c6028 HTTP/1.1" status: 200  len: 848 time: 0.0842128
Jun 01 06:14:25.895478 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-03c0a42c-305d-449c-a8f9-ff275f94ecd9 req-d070b41b-1b97-4f75-9bac-aa5ab1e8d3e2 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 210 time: 0.1415417
Jun 01 06:14:25.919119 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-22bbc7c5-1593-4896-b012-b2f94d770568 req-832e318f-8561-42d0-b189-40eba2d69318 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.48 "DELETE /v2.0/ports/690a6f90-fdb6-46f4-8f05-03e0ab827f78 HTTP/1.1" status: 204  len: 173 time: 1.5890384
Jun 01 06:14:26.002279 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-192a6b86-dbd4-44c4-b110-9fd2f767065a None None] New status for floating IP 5ed9ba98-8f9b-451e-b481-f30502ca4a26: ACTIVE {{(pid=92231) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 06:14:26.019368 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-221edb6f-3243-4254-a7cd-44774403146a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:26.023271 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e3f81f06-a5bf-40e2-bd4b-db14be73a3fa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:26.035700 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-221edb6f-3243-4254-a7cd-44774403146a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=719855e1-7591-4edd-9372-07a39658bbae,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:26.045223 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-221edb6f-3243-4254-a7cd-44774403146a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:26.051224 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-221edb6f-3243-4254-a7cd-44774403146a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:26.052711 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-221edb6f-3243-4254-a7cd-44774403146a admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/719855e1-7591-4edd-9372-07a39658bbae HTTP/1.1" status: 204  len: 168 time: 0.6401949
Jun 01 06:14:26.197975 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc11f7a-d901-427a-84ec-33539893e9ea req-b2df4c0f-9395-4383-846e-b6a4e5a73a02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:26.199857 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-bdc11f7a-d901-427a-84ec-33539893e9ea req-b2df4c0f-9395-4383-846e-b6a4e5a73a02 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=0f63ca6fed3e47a6a676979240aef5c0&device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 1098 time: 0.1324973
Jun 01 06:14:26.220855 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2257c372-838e-4047-8962-c85fb814d057 req-3ab9aed2-fecc-43d2-99a8-10b5c1f3bb12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:26.222809 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2257c372-838e-4047-8962-c85fb814d057 req-3ab9aed2-fecc-43d2-99a8-10b5c1f3bb12 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=6200246e-b324-4384-a0a9-6dc6726e2c6d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3172503
Jun 01 06:14:26.290030 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '601c5188-c17f-47a6-83cf-a69b68517e08', 'name': 'network-vif-deleted', 'tag': '690a6f90-fdb6-46f4-8f05-03e0ab827f78'}] {{(pid=92230) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:14:26.292877 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a8971187fdc179bafebfda031591b22633150c3ea1d9449252a7819502f19756" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e9e80d53-52b2-42b3-8a21-f46e9c59f0ca" -d '{"events": [{"server_uuid": "601c5188-c17f-47a6-83cf-a69b68517e08", "name": "network-vif-deleted", "tag": "690a6f90-fdb6-46f4-8f05-03e0ab827f78"}]}' {{(pid=92230) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:14:26.366227 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc11f7a-d901-427a-84ec-33539893e9ea req-bf08e0ff-df33-4472-ad59-5aeff4312a21 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:26.367825 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-bdc11f7a-d901-427a-84ec-33539893e9ea req-bf08e0ff-df33-4472-ad59-5aeff4312a21 service neutron] 10.222.0.48 "GET /v2.0/networks?id=5f973ed4-521b-4b78-9a54-1336b1302fa2 HTTP/1.1" status: 200  len: 917 time: 0.1598449
Jun 01 06:14:26.381148 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:14:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ba299a48-9ee2-4294-9049-2f9d24eb9dc1 x-openstack-request-id: req-ba299a48-9ee2-4294-9049-2f9d24eb9dc1 {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:14:26.381613 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "601c5188-c17f-47a6-83cf-a69b68517e08", "name": "network-vif-deleted", "tag": "690a6f90-fdb6-46f4-8f05-03e0ab827f78", "status": "completed", "code": 200}]} {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:14:26.381871 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-ba299a48-9ee2-4294-9049-2f9d24eb9dc1 {{(pid=92230) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:14:26.382344 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '601c5188-c17f-47a6-83cf-a69b68517e08', 'name': 'network-vif-deleted', 'tag': '690a6f90-fdb6-46f4-8f05-03e0ab827f78', 'status': 'completed', 'code': 200}
Jun 01 06:14:26.384861 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f623b5b-c616-4128-89dc-be69952cc940 req-2769869f-7046-417a-a177-cf16ad6453cc tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:26.386968 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4f623b5b-c616-4128-89dc-be69952cc940 req-2769869f-7046-417a-a177-cf16ad6453cc tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.3201556
Jun 01 06:14:26.419387 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [req-e04942a6-706c-4456-9713-8dcd7c92468f req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Allocated IP 172.20.0.12 (028fef0a-f05a-48d5-ba5c-b539846209ba/cdffe000-7f35-495d-a741-b4c48a060887/7d7451f5-3439-4d43-8bf7-ac121c8931c4) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:14:26.500626 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2257c372-838e-4047-8962-c85fb814d057 req-b5f8c814-20b1-4c7e-b83d-bf24fb1fa870 service neutron] 10.222.0.48 "GET /v2.0/networks/6200246e-b324-4384-a0a9-6dc6726e2c6d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2455685
Jun 01 06:14:26.506293 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4f623b5b-c616-4128-89dc-be69952cc940 req-5c21c804-ec77-4fd7-9da2-9533a7cfb3a2 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1080976
Jun 01 06:14:26.556580 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-bdc11f7a-d901-427a-84ec-33539893e9ea req-c0b4f75a-10fd-4e78-8eb2-cf6311766499 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=826848c6-a93a-4712-82dd-39e403bcb79e HTTP/1.1" status: 200  len: 1001 time: 0.1611323
Jun 01 06:14:26.645634 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc11f7a-d901-427a-84ec-33539893e9ea req-7a3498c8-757d-4dc0-9d01-19211cbd6028 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:26.647871 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-bdc11f7a-d901-427a-84ec-33539893e9ea req-7a3498c8-757d-4dc0-9d01-19211cbd6028 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=6137ee10-ce13-45c9-8edb-31811502bfd7 HTTP/1.1" status: 200  len: 855 time: 0.0856338
Jun 01 06:14:26.877880 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2257c372-838e-4047-8962-c85fb814d057 req-aa3a663e-b296-42d1-aad9-1ac6b923e253 service neutron] 10.222.0.48 "GET /v2.0/networks/6200246e-b324-4384-a0a9-6dc6726e2c6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3602610
Jun 01 06:14:26.881346 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc11f7a-d901-427a-84ec-33539893e9ea req-139c771d-8708-4c1d-b5b2-eebc235ff38d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:26.883899 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-bdc11f7a-d901-427a-84ec-33539893e9ea req-139c771d-8708-4c1d-b5b2-eebc235ff38d service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=5f973ed4-521b-4b78-9a54-1336b1302fa2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2281191
Jun 01 06:14:26.922962 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e04942a6-706c-4456-9713-8dcd7c92468f req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:26.930972 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d4657ec-6cc9-4bfe-95f0-8cc37e8bdb13 req-24d2fa89-8483-41ee-8a64-b832eff22c16 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:26.932487 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d4657ec-6cc9-4bfe-95f0-8cc37e8bdb13 req-24d2fa89-8483-41ee-8a64-b832eff22c16 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.2064328
Jun 01 06:14:26.967748 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-e04942a6-706c-4456-9713-8dcd7c92468f req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Transition to ACTIVE for port object 7d7451f5-3439-4d43-8bf7-ac121c8931c4 will not be triggered until provisioned by entity DHCP. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:14:26.994750 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d4657ec-6cc9-4bfe-95f0-8cc37e8bdb13 req-a6ae6889-397f-4509-b5fa-60e299c188f2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0503981
Jun 01 06:14:27.034452 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e04942a6-706c-4456-9713-8dcd7c92468f req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:27.041001 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:27.080009 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 35618) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:14:27.138894 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e04942a6-706c-4456-9713-8dcd7c92468f req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Network 028fef0a-f05a-48d5-ba5c-b539846209ba is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:14:27.142162 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [req-e04942a6-706c-4456-9713-8dcd7c92468f req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:14:27.147811 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-e04942a6-706c-4456-9713-8dcd7c92468f req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:14:27.149018 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-bdc11f7a-d901-427a-84ec-33539893e9ea req-739bd178-5afb-4b9e-9508-509f182e5943 service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2495766
Jun 01 06:14:27.158953 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e04942a6-706c-4456-9713-8dcd7c92468f req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:27.159915 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e04942a6-706c-4456-9713-8dcd7c92468f req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:27.170228 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Pushing event updated for resources: {'Port': ['ID=7d7451f5-3439-4d43-8bf7-ac121c8931c4,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:27.233960 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:27.234639 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:27.235148 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:27.235939 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:27.236621 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:27.237120 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:27.237615 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:27.238118 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:27.238467 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:27.238970 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:27.239472 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:27.240138 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:27.263023 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:27.324774 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-bdc11f7a-d901-427a-84ec-33539893e9ea req-1d112d9d-b2d2-4a1e-a283-2b5f89bebb61 service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1706672
Jun 01 06:14:27.406069 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d6964482-d129-4b24-a46e-3442967651d4 None None] Provisioning for port 7d7451f5-3439-4d43-8bf7-ac121c8931c4 completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:14:27.412886 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d6964482-d129-4b24-a46e-3442967651d4 None None] Provisioning complete for port 7d7451f5-3439-4d43-8bf7-ac121c8931c4 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:14:27.413344 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d6964482-d129-4b24-a46e-3442967651d4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:27.413626 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-276810473-network', 'tenant_id': 'dd97906039e7487cbb91b21981aa107c'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:14:27.423876 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:14:27.426665 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e04942a6-706c-4456-9713-8dcd7c92468f req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 2.1501718
Jun 01 06:14:27.437452 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Usage tracker for resource:network and tenant:dd97906039e7487cbb91b21981aa107c is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:14:27.444777 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:14:27.452120 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-e04942a6-706c-4456-9713-8dcd7c92468f req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Request body: {'port': {'device_id': '09215815-8dd9-46e4-879a-7c3b58e35a54', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79388'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:14:27.496419 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-d6964482-d129-4b24-a46e-3442967651d4 None None] Port 7d7451f5-3439-4d43-8bf7-ac121c8931c4 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:14:27.497609 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:14:27.533660 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Made reservation on behalf of dd97906039e7487cbb91b21981aa107c for: {'network': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:14:27.535968 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-8110114'] for network, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:27.584092 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:27.625691 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:14:27.639668 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-894c9a6e-26e8-4472-9689-a78f245399a8 req-4738a275-a399-4826-b836-241d1bf8da4b tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:27.640825 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-894c9a6e-26e8-4472-9689-a78f245399a8 req-4738a275-a399-4826-b836-241d1bf8da4b tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Synchronizing usage tracker for tenant:e8bcff3fed924886a68a8562a9f4f8f3 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:14:27.645483 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Usage tracker for resource:security_group_rule and tenant:dd97906039e7487cbb91b21981aa107c is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:14:27.650546 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:14:27.660037 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:14:27.672318 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccbc75de-5857-4033-bbd0-2ffddab4ae97 req-8b91a77b-3ac9-4e87-a848-dd5ff17fc440 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:27.673774 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ccbc75de-5857-4033-bbd0-2ffddab4ae97 req-8b91a77b-3ac9-4e87-a848-dd5ff17fc440 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=66ffd6b4-021c-479c-bc48-aa35c8846786 HTTP/1.1" status: 200  len: 945 time: 0.4205244
Jun 01 06:14:27.677835 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e04942a6-706c-4456-9713-8dcd7c92468f req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:27.769230 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-894c9a6e-26e8-4472-9689-a78f245399a8 req-4738a275-a399-4826-b836-241d1bf8da4b tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Unset dirty status for tenant:e8bcff3fed924886a68a8562a9f4f8f3 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:14:27.770287 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-894c9a6e-26e8-4472-9689-a78f245399a8 req-4738a275-a399-4826-b836-241d1bf8da4b tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 932 time: 0.5944576
Jun 01 06:14:27.837367 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 690a6f90-fdb6-46f4-8f05-03e0ab827f78 no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:14:27.841135 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ccbc75de-5857-4033-bbd0-2ffddab4ae97 req-f1e4d142-2cd0-4ae2-987b-782a53b2092f tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1475005
Jun 01 06:14:27.873714 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] No Port match for: 690a6f90-fdb6-46f4-8f05-03e0ab827f78 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:14:27.874052 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 690a6f90-fdb6-46f4-8f05-03e0ab827f78 not bound to the agent host hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:14:27.916921 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-894c9a6e-26e8-4472-9689-a78f245399a8 req-613c8dbc-6abb-4629-813e-eb176faeb061 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1358466
Jun 01 06:14:28.058630 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:28.114046 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:28.122296 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:28.202613 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] vlan segment allocate from pool success with {'vlan_id': 236, 'physical_network': 'physnet1'}  {{(pid=92229) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 06:14:28.241524 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:28.255519 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:28.255519 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.db.segments_db [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Added segment c333deab-77ad-4250-916e-537423452613 of type vlan for network a6c6ac39-c2dd-414b-b2c1-db0b208abb9a
Jun 01 06:14:28.260456 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:28.298642 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-404a12a0-964a-44a3-9a27-26a926a14643 req-b5626088-e36b-40cf-be8a-074046fdb0d1 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:28.300138 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-404a12a0-964a-44a3-9a27-26a926a14643 req-b5626088-e36b-40cf-be8a-074046fdb0d1 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.3518660
Jun 01 06:14:28.324830 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8788496565589'] for network, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:28.408827 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d228f56-0973-4d21-b0b4-c4b976c4cf85 req-41858b73-2505-4b0a-80d6-acebcc6c56df tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:28.410326 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1d228f56-0973-4d21-b0b4-c4b976c4cf85 req-41858b73-2505-4b0a-80d6-acebcc6c56df tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.2930679
Jun 01 06:14:28.445972 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-404a12a0-964a-44a3-9a27-26a926a14643 req-8c4f712a-7d05-4d52-bbb8-fa07df05d63c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1281538
Jun 01 06:14:28.493218 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104'] for network, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:28.499208 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:28.499802 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:28.514524 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:28.528981 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [req-e04942a6-706c-4456-9713-8dcd7c92468f req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7d7451f5-3439-4d43-8bf7-ac121c8931c4 {{(pid=92229) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:14:28.600100 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e04942a6-706c-4456-9713-8dcd7c92468f req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:28.618973 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1d228f56-0973-4d21-b0b4-c4b976c4cf85 req-f8e11c8a-c018-46fd-8d07-702117e9f860 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1706657
Jun 01 06:14:28.645263 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 1.5591450
Jun 01 06:14:28.647553 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Pushing event updated for resources: {'Network': ['ID=a6c6ac39-c2dd-414b-b2c1-db0b208abb9a,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:28.649542 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 35630) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:14:28.650513 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-e04942a6-706c-4456-9713-8dcd7c92468f req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Transition to ACTIVE for port object 7d7451f5-3439-4d43-8bf7-ac121c8931c4 will not be triggered until provisioned by entity L2. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:14:28.654040 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:28.658568 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-efd2ecc5-c439-4e4f-b32a-3ee3ae0f0df9 admin admin] Request body: {'subnet': {'network_id': 'a6c6ac39-c2dd-414b-b2c1-db0b208abb9a', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-276810473-subnet', 'tenant_id': 'dd97906039e7487cbb91b21981aa107c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:14:28.659944 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Network a6c6ac39-c2dd-414b-b2c1-db0b208abb9a details requested by agent ovs-agent-dv-cinder-793885-1-iscsi with host dv-cinder-793885-1-iscsi {{(pid=92231) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 06:14:28.662814 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e04942a6-706c-4456-9713-8dcd7c92468f req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:28.668517 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-efd2ecc5-c439-4e4f-b32a-3ee3ae0f0df9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:14:28.670735 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:28.684885 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-575f7595-545d-4712-89fa-360fd6b4ee11 req-4a7f7fbe-f9ca-4935-964b-d418d2772065 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:28.685586 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-575f7595-545d-4712-89fa-360fd6b4ee11 req-4a7f7fbe-f9ca-4935-964b-d418d2772065 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Synchronizing usage tracker for tenant:b02068c8f29e4f5e9b3c965d023f7e29 on resource:port {{(pid=92230) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:14:28.701190 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-575f7595-545d-4712-89fa-360fd6b4ee11 req-4a7f7fbe-f9ca-4935-964b-d418d2772065 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Unset dirty status for tenant:b02068c8f29e4f5e9b3c965d023f7e29 on resource:port {{(pid=92230) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:14:28.702334 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-575f7595-545d-4712-89fa-360fd6b4ee11 req-4a7f7fbe-f9ca-4935-964b-d418d2772065 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.48 "GET /v2.0/ports?device_id=66ffd6b4-021c-479c-bc48-aa35c8846786 HTTP/1.1" status: 200  len: 945 time: 0.1122851
Jun 01 06:14:28.713337 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-efd2ecc5-c439-4e4f-b32a-3ee3ae0f0df9 admin admin] Usage tracker for resource:subnet and tenant:dd97906039e7487cbb91b21981aa107c is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:14:28.724821 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-efd2ecc5-c439-4e4f-b32a-3ee3ae0f0df9 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:14:28.743423 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-efd2ecc5-c439-4e4f-b32a-3ee3ae0f0df9 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:14:28.825403 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Pushing event updated for resources: {'Port': ['ID=7d7451f5-3439-4d43-8bf7-ac121c8931c4,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:28.850484 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [req-575f7595-545d-4712-89fa-360fd6b4ee11 req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Deleting port b83de976-8a2a-4caf-b3a4-4f2d2016ddd4 {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:14:28.850683 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-575f7595-545d-4712-89fa-360fd6b4ee11 req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:28.859258 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:28.859498 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-efd2ecc5-c439-4e4f-b32a-3ee3ae0f0df9 admin admin] Made reservation on behalf of dd97906039e7487cbb91b21981aa107c for: {'subnet': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:14:28.861762 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-efd2ecc5-c439-4e4f-b32a-3ee3ae0f0df9 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:28.964682 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-e04942a6-706c-4456-9713-8dcd7c92468f req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Attempting to bind port 7d7451f5-3439-4d43-8bf7-ac121c8931c4 on host hv-cinder-79388 for vnic_type normal with profile  {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:14:28.965399 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-e04942a6-706c-4456-9713-8dcd7c92468f req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Attempting to bind port 7d7451f5-3439-4d43-8bf7-ac121c8931c4 by drivers openvswitch,hyperv on host hv-cinder-79388 at level 0 using segments [{'id': 'e9a368be-e119-4f56-bdcc-b9d10543e0d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 209, 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba'}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:14:28.965683 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e04942a6-706c-4456-9713-8dcd7c92468f req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Attempting to bind port 7d7451f5-3439-4d43-8bf7-ac121c8931c4 on network 028fef0a-f05a-48d5-ba5c-b539846209ba {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:14:28.977369 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e04942a6-706c-4456-9713-8dcd7c92468f req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Port 7d7451f5-3439-4d43-8bf7-ac121c8931c4 on network 028fef0a-f05a-48d5-ba5c-b539846209ba not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79388 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 06:14:28.977677 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e04942a6-706c-4456-9713-8dcd7c92468f req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Attempting to bind port 7d7451f5-3439-4d43-8bf7-ac121c8931c4 on network 028fef0a-f05a-48d5-ba5c-b539846209ba {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:14:28.988679 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e04942a6-706c-4456-9713-8dcd7c92468f req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Checking agent: {'id': '56148394-2131-4d06-bcfa-c032301591b8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79388', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'started_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 14, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:14:28.988896 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e04942a6-706c-4456-9713-8dcd7c92468f req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Checking segment: {'id': 'e9a368be-e119-4f56-bdcc-b9d10543e0d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 209, 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:14:28.989194 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e04942a6-706c-4456-9713-8dcd7c92468f req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Bound using segment: {'id': 'e9a368be-e119-4f56-bdcc-b9d10543e0d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 209, 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba'} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:14:28.989521 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-e04942a6-706c-4456-9713-8dcd7c92468f req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Bound port: 7d7451f5-3439-4d43-8bf7-ac121c8931c4, host: hv-cinder-79388, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e9a368be-e119-4f56-bdcc-b9d10543e0d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 209, 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba'}}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:14:28.989869 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e04942a6-706c-4456-9713-8dcd7c92468f req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:29.013368 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [req-575f7595-545d-4712-89fa-360fd6b4ee11 req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] For port b83de976-8a2a-4caf-b3a4-4f2d2016ddd4, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=b83de976-8a2a-4caf-b3a4-4f2d2016ddd4,segment=NetworkSegment(7e12089c-d8cc-429c-8b7b-f5d148a55957),segment_id=7e12089c-d8cc-429c-8b7b-f5d148a55957)] {{(pid=92230) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:14:29.014374 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-575f7595-545d-4712-89fa-360fd6b4ee11 req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:29.159425 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [req-575f7595-545d-4712-89fa-360fd6b4ee11 req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Calling delete_port for b83de976-8a2a-4caf-b3a4-4f2d2016ddd4 owned by compute:nova {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:14:29.290464 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-575f7595-545d-4712-89fa-360fd6b4ee11 req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:29.296673 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:29.302554 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['de8f02a4-b74f-47df-a797-bc3cbe7be366', 'b83de976-8a2a-4caf-b3a4-4f2d2016ddd4'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:14:29.348433 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Pushing event deleted for resources: {'Port': ['ID=b83de976-8a2a-4caf-b3a4-4f2d2016ddd4,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:29.383239 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:29.383795 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:29.384167 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:29.384375 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-e04942a6-706c-4456-9713-8dcd7c92468f req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] For port 7d7451f5-3439-4d43-8bf7-ac121c8931c4, host hv-cinder-79388, cleared binding levels {{(pid=92229) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:14:29.384508 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:29.384872 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:29.385216 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:29.385582 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:29.386533 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:29.387115 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:29.387584 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:29.387963 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:29.388316 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:29.397251 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:29.404598 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-e04942a6-706c-4456-9713-8dcd7c92468f req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] For port 7d7451f5-3439-4d43-8bf7-ac121c8931c4, host hv-cinder-79388, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=7d7451f5-3439-4d43-8bf7-ac121c8931c4,segment=NetworkSegment(e9a368be-e119-4f56-bdcc-b9d10543e0d8),segment_id=e9a368be-e119-4f56-bdcc-b9d10543e0d8)] {{(pid=92229) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:14:29.413865 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29fa1934-864a-4083-a55e-105d6333f23f req-86bf7ef1-7952-4525-b244-968af73183f4 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:29.415331 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-29fa1934-864a-4083-a55e-105d6333f23f req-86bf7ef1-7952-4525-b244-968af73183f4 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=66ffd6b4-021c-479c-bc48-aa35c8846786 HTTP/1.1" status: 200  len: 945 time: 0.4323382
Jun 01 06:14:29.439804 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e04942a6-706c-4456-9713-8dcd7c92468f req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:29.440738 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [req-575f7595-545d-4712-89fa-360fd6b4ee11 req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] No DVR routers for this DVR port b83de976-8a2a-4caf-b3a4-4f2d2016ddd4 on host hv-cinder-79388 {{(pid=92230) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:14:29.443222 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-575f7595-545d-4712-89fa-360fd6b4ee11 req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:29.446236 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '66ffd6b4-021c-479c-bc48-aa35c8846786', 'name': 'network-vif-deleted', 'tag': 'b83de976-8a2a-4caf-b3a4-4f2d2016ddd4'}] {{(pid=92230) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:14:29.449436 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a8971187fdc179bafebfda031591b22633150c3ea1d9449252a7819502f19756" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6e4101c9-e436-41ae-a6d9-f3277d8c370c" -d '{"events": [{"server_uuid": "66ffd6b4-021c-479c-bc48-aa35c8846786", "name": "network-vif-deleted", "tag": "b83de976-8a2a-4caf-b3a4-4f2d2016ddd4"}]}' {{(pid=92230) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:14:29.458383 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-4cf4a933-ba53-4c47-b90f-851f47186344 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:29.465416 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-575f7595-545d-4712-89fa-360fd6b4ee11 req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.48 "DELETE /v2.0/ports/b83de976-8a2a-4caf-b3a4-4f2d2016ddd4 HTTP/1.1" status: 204  len: 173 time: 0.7564945
Jun 01 06:14:29.549178 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ae09303-60cd-49f4-afb5-e40575f80224 req-a1c78f16-d9fd-4171-a323-e2c67da0016b tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:29.550723 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8ae09303-60cd-49f4-afb5-e40575f80224 req-a1c78f16-d9fd-4171-a323-e2c67da0016b tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 944 time: 0.4580729
Jun 01 06:14:29.566503 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e04942a6-706c-4456-9713-8dcd7c92468f req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:29.567992 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e04942a6-706c-4456-9713-8dcd7c92468f req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:29.569916 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e04942a6-706c-4456-9713-8dcd7c92468f req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] 10.222.0.48 "PUT /v2.0/ports/7d7451f5-3439-4d43-8bf7-ac121c8931c4 HTTP/1.1" status: 200  len: 1094 time: 2.1295328
Jun 01 06:14:29.575492 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '09215815-8dd9-46e4-879a-7c3b58e35a54', 'tag': '7d7451f5-3439-4d43-8bf7-ac121c8931c4'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:14:29.577831 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-22f351f8-9613-4dc0-a6f2-68eef2544947" -d '{"events": [{"name": "network-changed", "server_uuid": "09215815-8dd9-46e4-879a-7c3b58e35a54", "tag": "7d7451f5-3439-4d43-8bf7-ac121c8931c4"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:14:29.638536 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-29fa1934-864a-4083-a55e-105d6333f23f req-74233661-a207-4374-8146-a115b0272059 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2064235
Jun 01 06:14:29.672216 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Pushing event updated for resources: {'Port': ['ID=7d7451f5-3439-4d43-8bf7-ac121c8931c4,revision_number=3']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:29.734930 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:14:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3f30dcaf-d049-4dfd-8db2-16b9e8064eb0 x-openstack-request-id: req-3f30dcaf-d049-4dfd-8db2-16b9e8064eb0 {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:14:29.735435 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "66ffd6b4-021c-479c-bc48-aa35c8846786", "name": "network-vif-deleted", "tag": "b83de976-8a2a-4caf-b3a4-4f2d2016ddd4", "status": "completed", "code": 200}]} {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:14:29.735678 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-3f30dcaf-d049-4dfd-8db2-16b9e8064eb0 {{(pid=92230) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:14:29.736192 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '66ffd6b4-021c-479c-bc48-aa35c8846786', 'name': 'network-vif-deleted', 'tag': 'b83de976-8a2a-4caf-b3a4-4f2d2016ddd4', 'status': 'completed', 'code': 200}
Jun 01 06:14:29.762338 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.304s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:29.771896 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8ae09303-60cd-49f4-afb5-e40575f80224 req-b1d53bb4-2a97-425d-994c-e7cbc5d02d5a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2066095
Jun 01 06:14:29.839956 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:14:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a05a59b2-67f3-4811-a6a8-c11a44f4fb94 x-openstack-request-id: req-a05a59b2-67f3-4811-a6a8-c11a44f4fb94 {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:14:29.840264 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "09215815-8dd9-46e4-879a-7c3b58e35a54", "tag": "7d7451f5-3439-4d43-8bf7-ac121c8931c4", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:14:29.840544 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-a05a59b2-67f3-4811-a6a8-c11a44f4fb94 {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:14:29.840977 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '09215815-8dd9-46e4-879a-7c3b58e35a54', 'tag': '7d7451f5-3439-4d43-8bf7-ac121c8931c4', 'status': 'completed', 'code': 200}
Jun 01 06:14:29.872355 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 826848c6-a93a-4712-82dd-39e403bcb79e no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:14:29.900936 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e04942a6-706c-4456-9713-8dcd7c92468f req-5cccc7c9-1073-47eb-b802-cc2c73d1e5e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:29.902954 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e04942a6-706c-4456-9713-8dcd7c92468f req-5cccc7c9-1073-47eb-b802-cc2c73d1e5e2 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=e8bcff3fed924886a68a8562a9f4f8f3&device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 1097 time: 0.2331147
Jun 01 06:14:29.991801 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:30.020699 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1385f5c8-2a7a-45b1-a982-6f897700aa17', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '826848c6-a93a-4712-82dd-39e403bcb79e'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:14:30.023086 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-644b7051-10a2-47e6-b230-dc3f8a630564" -d '{"events": [{"server_uuid": "1385f5c8-2a7a-45b1-a982-6f897700aa17", "name": "network-vif-unplugged", "status": "completed", "tag": "826848c6-a93a-4712-82dd-39e403bcb79e"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:14:30.031877 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 826848c6-a93a-4712-82dd-39e403bcb79e, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=826848c6-a93a-4712-82dd-39e403bcb79e,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:14:30.034445 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e04942a6-706c-4456-9713-8dcd7c92468f req-47948985-795a-40eb-9bad-289ca8bff243 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7d7451f5-3439-4d43-8bf7-ac121c8931c4 HTTP/1.1" status: 200  len: 217 time: 0.1146955
Jun 01 06:14:30.036632 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:30.037521 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device b83de976-8a2a-4caf-b3a4-4f2d2016ddd4 no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:14:30.070707 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:30.126479 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] No Port match for: b83de976-8a2a-4caf-b3a4-4f2d2016ddd4 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:14:30.126810 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device b83de976-8a2a-4caf-b3a4-4f2d2016ddd4 not bound to the agent host hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:14:30.133215 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75e1bfae-7b68-4a56-9b2f-e7a3153dfe74 req-169dd079-d652-47ce-beda-60e6f22c0573 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:30.134702 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-75e1bfae-7b68-4a56-9b2f-e7a3153dfe74 req-169dd079-d652-47ce-beda-60e6f22c0573 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 945 time: 0.2999966
Jun 01 06:14:30.155639 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=826848c6-a93a-4712-82dd-39e403bcb79e,revision_number=8']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:30.162923 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:30.163260 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:30.163581 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:30.164207 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:30.164590 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:30.165030 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:30.165370 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:30.165834 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:30.166155 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:30.166467 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:30.166798 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:30.167159 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:14:30.171408 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:30.200681 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e04942a6-706c-4456-9713-8dcd7c92468f req-92ef1de9-30bf-4383-b60b-5dd6d1c0a14b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:30.202115 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e04942a6-706c-4456-9713-8dcd7c92468f req-92ef1de9-30bf-4383-b60b-5dd6d1c0a14b service neutron] 10.222.0.48 "GET /v2.0/subnets?id=cdffe000-7f35-495d-a741-b4c48a060887 HTTP/1.1" status: 200  len: 850 time: 0.1577601
Jun 01 06:14:30.296068 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-710e5f25-f7b8-4801-a972-ea77602edff3 req-c1bcc5f3-d016-4f52-857c-d8bee05503e5 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:30.297529 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-710e5f25-f7b8-4801-a972-ea77602edff3 req-c1bcc5f3-d016-4f52-857c-d8bee05503e5 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.3262348
Jun 01 06:14:30.307020 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-75e1bfae-7b68-4a56-9b2f-e7a3153dfe74 req-aeca8ac4-e375-4d6e-8f1d-67e7621d4af7 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1573522
Jun 01 06:14:30.333891 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-efd2ecc5-c439-4e4f-b32a-3ee3ae0f0df9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099'] for subnet, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:30.346838 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-c9a8b8d9-cc77-4c38-8ca0-7187cdcadd21 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:30.358542 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 01 Jun 2021 06:14:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1f895151-507d-48c6-99fc-77eadcadb5d2 x-openstack-request-id: req-1f895151-507d-48c6-99fc-77eadcadb5d2 {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:14:30.359138 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1385f5c8-2a7a-45b1-a982-6f897700aa17", "name": "network-vif-unplugged", "status": "failed", "tag": "826848c6-a93a-4712-82dd-39e403bcb79e", "code": 422}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:14:30.359661 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-1f895151-507d-48c6-99fc-77eadcadb5d2 {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:14:30.360316 dv-cinder-793885-1-iscsi neutron-server[92231]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '1385f5c8-2a7a-45b1-a982-6f897700aa17', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '826848c6-a93a-4712-82dd-39e403bcb79e', 'code': 422} returned with failed status
Jun 01 06:14:30.427108 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-710e5f25-f7b8-4801-a972-ea77602edff3 req-d4f6cc81-7faf-4879-8593-580391d0e750 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1229355
Jun 01 06:14:30.457046 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efd2ecc5-c439-4e4f-b32a-3ee3ae0f0df9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c6893b02-9e5e-4658-acac-8bef895b0956,revision_number=0']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:30.461690 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e04942a6-706c-4456-9713-8dcd7c92468f req-6ce7dca1-e1e2-4a26-8281-19bf09fc0146 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:30.463510 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e04942a6-706c-4456-9713-8dcd7c92468f req-6ce7dca1-e1e2-4a26-8281-19bf09fc0146 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=028fef0a-f05a-48d5-ba5c-b539846209ba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2466474
Jun 01 06:14:30.463992 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-efd2ecc5-c439-4e4f-b32a-3ee3ae0f0df9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:30.470465 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-efd2ecc5-c439-4e4f-b32a-3ee3ae0f0df9 admin admin] Checking segment: {'id': 'c333deab-77ad-4250-916e-537423452613', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 236, 'network_id': 'a6c6ac39-c2dd-414b-b2c1-db0b208abb9a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:14:30.470877 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-efd2ecc5-c439-4e4f-b32a-3ee3ae0f0df9 admin admin] Network hostable DHCP agents. Network: a6c6ac39-c2dd-414b-b2c1-db0b208abb9a, hostable agents: ['648832f0-f26e-4e29-ac0d-d97e4a75c6c4'], hosted agents: [] {{(pid=92229) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 06:14:30.580429 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-efd2ecc5-c439-4e4f-b32a-3ee3ae0f0df9 admin admin] Network a6c6ac39-c2dd-414b-b2c1-db0b208abb9a is scheduled to be hosted by DHCP agent 648832f0-f26e-4e29-ac0d-d97e4a75c6c4 with binding_index 1 {{(pid=92229) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 06:14:30.605867 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-efd2ecc5-c439-4e4f-b32a-3ee3ae0f0df9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793885-1-iscsi, a6c6ac39-c2dd-414b-b2c1-db0b208abb9a) {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:14:30.614739 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18ec64fd-d828-42ff-a608-f394821038b4 None None] Network a6c6ac39-c2dd-414b-b2c1-db0b208abb9a requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:14:30.620289 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-efd2ecc5-c439-4e4f-b32a-3ee3ae0f0df9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:30.620867 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-efd2ecc5-c439-4e4f-b32a-3ee3ae0f0df9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:30.639589 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e04942a6-706c-4456-9713-8dcd7c92468f req-57b57258-7bd3-4b5f-b62f-bb7e81b23ba1 service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1657217
Jun 01 06:14:30.655155 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-efd2ecc5-c439-4e4f-b32a-3ee3ae0f0df9 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 1.9975250
Jun 01 06:14:30.856682 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e04942a6-706c-4456-9713-8dcd7c92468f req-e6f7b0e8-0d85-497b-b3be-36e071f4bc0f service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2088354
Jun 01 06:14:30.917862 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17c538e7-9ed6-4608-93d4-4f051a7d50dc None None] Network a6c6ac39-c2dd-414b-b2c1-db0b208abb9a requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:14:31.043925 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22f351f8-9613-4dc0-a6f2-68eef2544947 req-209b12ca-6126-4ab7-a72f-22704b9e7e3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:31.046166 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-22f351f8-9613-4dc0-a6f2-68eef2544947 req-209b12ca-6126-4ab7-a72f-22704b9e7e3e service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=e8bcff3fed924886a68a8562a9f4f8f3&device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 1097 time: 0.0988040
Jun 01 06:14:31.092689 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea486b93-2044-4fcc-a9a1-128aab972fad req-5c10ab46-476a-4317-8879-fca0bfc311c6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:31.099720 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ea486b93-2044-4fcc-a9a1-128aab972fad req-5c10ab46-476a-4317-8879-fca0bfc311c6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 944 time: 0.1380436
Jun 01 06:14:31.103115 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02e76fa7-366e-4b5d-a1ff-f1fec9f3b69d req-8e323ecb-7bb4-4980-8eca-9ea3a9a53099 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:31.105366 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-02e76fa7-366e-4b5d-a1ff-f1fec9f3b69d req-8e323ecb-7bb4-4980-8eca-9ea3a9a53099 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 1098 time: 0.1913574
Jun 01 06:14:31.174442 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ea486b93-2044-4fcc-a9a1-128aab972fad req-edd47cdc-f601-40b3-b70b-e982919f6f86 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0736632
Jun 01 06:14:31.206728 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-02e76fa7-366e-4b5d-a1ff-f1fec9f3b69d req-ab9c46f9-bc04-4baa-b047-cb50eb3a0911 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0879245
Jun 01 06:14:31.246481 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22f351f8-9613-4dc0-a6f2-68eef2544947 req-9dd1524d-ab6c-446b-a2c6-168698440948 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:31.247995 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-22f351f8-9613-4dc0-a6f2-68eef2544947 req-9dd1524d-ab6c-446b-a2c6-168698440948 service neutron] 10.222.0.48 "GET /v2.0/networks?id=028fef0a-f05a-48d5-ba5c-b539846209ba HTTP/1.1" status: 200  len: 912 time: 0.1952326
Jun 01 06:14:31.350067 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-22f351f8-9613-4dc0-a6f2-68eef2544947 req-f6c04087-8927-4a00-9441-c5ee98278bba service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7d7451f5-3439-4d43-8bf7-ac121c8931c4 HTTP/1.1" status: 200  len: 217 time: 0.0921657
Jun 01 06:14:31.444457 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22f351f8-9613-4dc0-a6f2-68eef2544947 req-f26eff87-f0c5-4b2a-b9d2-1fb75d6178cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:31.446200 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-22f351f8-9613-4dc0-a6f2-68eef2544947 req-f26eff87-f0c5-4b2a-b9d2-1fb75d6178cb service neutron] 10.222.0.48 "GET /v2.0/subnets?id=cdffe000-7f35-495d-a741-b4c48a060887 HTTP/1.1" status: 200  len: 850 time: 0.0845084
Jun 01 06:14:31.587928 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22f351f8-9613-4dc0-a6f2-68eef2544947 req-ca92bf0d-41fa-4890-8a9c-71ce2666dc6d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:31.596810 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-22f351f8-9613-4dc0-a6f2-68eef2544947 req-ca92bf0d-41fa-4890-8a9c-71ce2666dc6d service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=028fef0a-f05a-48d5-ba5c-b539846209ba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1321168
Jun 01 06:14:31.635160 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a29903d-b9dd-4858-a1eb-97b0c1518a9f req-68403db5-9537-4f69-9575-d92595b524dd tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:31.642785 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6a29903d-b9dd-4858-a1eb-97b0c1518a9f req-68403db5-9537-4f69-9575-d92595b524dd tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.1548700
Jun 01 06:14:31.710401 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6a29903d-b9dd-4858-a1eb-97b0c1518a9f req-4b87837a-82b8-49a4-b44e-3d64c737c281 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0666699
Jun 01 06:14:31.757511 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c55a541-47d9-474d-ac05-94bdde6cc201 req-f7a33730-b901-43da-b578-8caee807e180 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:31.759069 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0c55a541-47d9-474d-ac05-94bdde6cc201 req-f7a33730-b901-43da-b578-8caee807e180 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1946754
Jun 01 06:14:31.938594 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-22f351f8-9613-4dc0-a6f2-68eef2544947 req-98166b19-b421-4284-88d2-139938199106 service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3339574
Jun 01 06:14:31.953515 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0c55a541-47d9-474d-ac05-94bdde6cc201 req-4154a5d6-1c98-451f-b7fb-d31e75f02a01 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1855595
Jun 01 06:14:31.963437 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 35712) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:14:32.096097 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c6a315f3-c58e-4d72-bba3-0f9d17cf4593 req-612881c8-e60a-4158-b04b-113825695f04 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1323311
Jun 01 06:14:32.115967 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-22f351f8-9613-4dc0-a6f2-68eef2544947 req-70ae4351-c6bd-4f55-836a-28090e045fe7 service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1634083
Jun 01 06:14:32.376286 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77c895e7-ec52-4653-9f8b-bce673c05812 req-a155a069-b5ca-4536-a3f2-c7e47bdf74ba tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:32.377806 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-77c895e7-ec52-4653-9f8b-bce673c05812 req-a155a069-b5ca-4536-a3f2-c7e47bdf74ba tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 944 time: 0.0884552
Jun 01 06:14:32.429358 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-77c895e7-ec52-4653-9f8b-bce673c05812 req-481066d3-5cfa-4eed-ae6c-a5bf82068e96 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0452373
Jun 01 06:14:32.738730 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65a8f200-1980-4cba-afd9-a574a1106a73 req-c2c19a9b-b1a5-47b8-a19a-002363a5f6e6 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:32.740301 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-65a8f200-1980-4cba-afd9-a574a1106a73 req-c2c19a9b-b1a5-47b8-a19a-002363a5f6e6 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 945 time: 0.0807188
Jun 01 06:14:32.795325 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-65a8f200-1980-4cba-afd9-a574a1106a73 req-e35f2d26-d70d-481c-96bd-dd20bc06dee1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0480318
Jun 01 06:14:32.940034 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e286f132-3e6a-48e2-9440-75528a393073 req-f4e1b4ce-c2fa-4cb8-9485-8bad62b4675c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:32.941494 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e286f132-3e6a-48e2-9440-75528a393073 req-f4e1b4ce-c2fa-4cb8-9485-8bad62b4675c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.0999811
Jun 01 06:14:33.066996 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e286f132-3e6a-48e2-9440-75528a393073 req-ea0253fa-0d8c-4af5-aa1f-4e7dc5519225 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1193559
Jun 01 06:14:33.137005 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2634502-e244-45ff-a170-412e2a074bcf req-0d5a2030-3527-47c1-b31e-b968cb6c2f30 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:33.137712 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-e2634502-e244-45ff-a170-412e2a074bcf req-0d5a2030-3527-47c1-b31e-b968cb6c2f30 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Synchronizing usage tracker for tenant:dd97906039e7487cbb91b21981aa107c on resource:network {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:14:33.154270 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-e2634502-e244-45ff-a170-412e2a074bcf req-0d5a2030-3527-47c1-b31e-b968cb6c2f30 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Unset dirty status for tenant:dd97906039e7487cbb91b21981aa107c on resource:network {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:14:33.155677 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e2634502-e244-45ff-a170-412e2a074bcf req-0d5a2030-3527-47c1-b31e-b968cb6c2f30 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/networks?id=a6c6ac39-c2dd-414b-b2c1-db0b208abb9a HTTP/1.1" status: 200  len: 808 time: 0.1880760
Jun 01 06:14:33.205783 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e2634502-e244-45ff-a170-412e2a074bcf req-c06ecfd0-baca-411e-b48b-9386617cb6fd tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/quotas/dd97906039e7487cbb91b21981aa107c HTTP/1.1" status: 200  len: 375 time: 0.0444095
Jun 01 06:14:33.267001 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e2634502-e244-45ff-a170-412e2a074bcf req-351f80c2-f11b-4117-bba2-b39d25fd65b4 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=dd97906039e7487cbb91b21981aa107c&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0552013
Jun 01 06:14:33.378401 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ec4d983-39a3-4987-9234-36975dfd8b1f req-bd0fa030-8631-43db-80d3-b27b87509e6f tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:33.379881 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6ec4d983-39a3-4987-9234-36975dfd8b1f req-bd0fa030-8631-43db-80d3-b27b87509e6f tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.2119424
Jun 01 06:14:33.452113 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e2634502-e244-45ff-a170-412e2a074bcf req-c487be12-34fa-4bcc-a2ef-d856e2b5a876 service neutron] 10.222.0.25 "GET /v2.0/networks/a6c6ac39-c2dd-414b-b2c1-db0b208abb9a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1766677
Jun 01 06:14:33.456908 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6ec4d983-39a3-4987-9234-36975dfd8b1f req-90347b54-ec8e-4ebf-9f4b-ed0af65edad4 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0695925
Jun 01 06:14:33.638951 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e2634502-e244-45ff-a170-412e2a074bcf req-e735c3de-36d9-4866-9bf5-6299615e36b6 service neutron] 10.222.0.25 "GET /v2.0/networks/a6c6ac39-c2dd-414b-b2c1-db0b208abb9a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1806858
Jun 01 06:14:33.676441 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-924a4c1b-e0af-49cb-a5a3-a193086949bf req-b08ef2d5-fa53-4102-b7bd-a20765f70189 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:33.677890 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-924a4c1b-e0af-49cb-a5a3-a193086949bf req-b08ef2d5-fa53-4102-b7bd-a20765f70189 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 944 time: 0.1093876
Jun 01 06:14:33.724871 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-924a4c1b-e0af-49cb-a5a3-a193086949bf req-49bde15c-4baa-4849-a3bd-edea89d505a0 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0406997
Jun 01 06:14:33.826756 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-66dcf926-093d-404a-84c8-5aabf9739430 req-af2e9757-6fef-4e01-8588-22981a0f6b5a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 210 time: 0.0455251
Jun 01 06:14:34.049765 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e780d82a-6843-41bc-9582-d15d733ea14d req-5b35345c-aa30-4781-bdfd-311d14b81060 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:34.052210 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e780d82a-6843-41bc-9582-d15d733ea14d req-5b35345c-aa30-4781-bdfd-311d14b81060 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 945 time: 0.1074607
Jun 01 06:14:34.061549 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6a315f3-c58e-4d72-bba3-0f9d17cf4593 req-bd80b47b-f859-4b88-85b2-e595e6b72b3a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:34.063218 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-c6a315f3-c58e-4d72-bba3-0f9d17cf4593 req-bd80b47b-f859-4b88-85b2-e595e6b72b3a service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17&tenant_id=0f63ca6fed3e47a6a676979240aef5c0 HTTP/1.1" status: 200  len: 1096 time: 0.1035240
Jun 01 06:14:34.113146 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e780d82a-6843-41bc-9582-d15d733ea14d req-8756b2ab-97ac-4c03-b984-7418097421e9 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0524116
Jun 01 06:14:34.194138 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6a315f3-c58e-4d72-bba3-0f9d17cf4593 req-f1d24bd4-e7d2-447d-aca3-a59434cfd6e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:34.195834 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-c6a315f3-c58e-4d72-bba3-0f9d17cf4593 req-f1d24bd4-e7d2-447d-aca3-a59434cfd6e7 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=0f63ca6fed3e47a6a676979240aef5c0&device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 1096 time: 0.1054888
Jun 01 06:14:34.358229 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6a315f3-c58e-4d72-bba3-0f9d17cf4593 req-eb619949-bdc4-4e0b-823e-39e0c6de768d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:34.359682 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-c6a315f3-c58e-4d72-bba3-0f9d17cf4593 req-eb619949-bdc4-4e0b-823e-39e0c6de768d service neutron] 10.222.0.48 "GET /v2.0/networks?id=5f973ed4-521b-4b78-9a54-1336b1302fa2 HTTP/1.1" status: 200  len: 917 time: 0.1491649
Jun 01 06:14:34.475324 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44e1fce5-6399-4321-9de1-0e398b7cc832 req-583e5329-e470-4cb3-8894-4e0bb52cc7c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:34.476908 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-44e1fce5-6399-4321-9de1-0e398b7cc832 req-583e5329-e470-4cb3-8894-4e0bb52cc7c6 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=8f1cf739e243401eb5da7ee705e856de&device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 1098 time: 0.2645817
Jun 01 06:14:34.478002 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-c6a315f3-c58e-4d72-bba3-0f9d17cf4593 req-5ad6cedf-7217-48c7-85ef-1ba95074dac5 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=826848c6-a93a-4712-82dd-39e403bcb79e HTTP/1.1" status: 200  len: 999 time: 0.1112363
Jun 01 06:14:34.491463 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d26ad85-7d4b-4154-ac64-e9be1eae1a95 req-e011fbac-2e81-49eb-843e-7d52e96bf900 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:34.492935 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1d26ad85-7d4b-4154-ac64-e9be1eae1a95 req-e011fbac-2e81-49eb-843e-7d52e96bf900 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.2157156
Jun 01 06:14:34.550670 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e214ab3-44b8-46a6-9a14-c37821f2c582 req-559c49bb-2242-45c9-a3b8-87433ca63be2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:34.552259 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4e214ab3-44b8-46a6-9a14-c37821f2c582 req-559c49bb-2242-45c9-a3b8-87433ca63be2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.2689698
Jun 01 06:14:34.556552 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6a315f3-c58e-4d72-bba3-0f9d17cf4593 req-07ff7ea1-0ff3-40a6-8e89-95508c48e6cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:34.558785 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-c6a315f3-c58e-4d72-bba3-0f9d17cf4593 req-07ff7ea1-0ff3-40a6-8e89-95508c48e6cb service neutron] 10.222.0.48 "GET /v2.0/subnets?id=6137ee10-ce13-45c9-8edb-31811502bfd7 HTTP/1.1" status: 200  len: 855 time: 0.0673864
Jun 01 06:14:34.646542 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6a315f3-c58e-4d72-bba3-0f9d17cf4593 req-a21d6761-daf2-4a8d-a779-754b18d642bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:34.648091 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-c6a315f3-c58e-4d72-bba3-0f9d17cf4593 req-a21d6761-daf2-4a8d-a779-754b18d642bb service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=5f973ed4-521b-4b78-9a54-1336b1302fa2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0828753
Jun 01 06:14:34.716110 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:14:34.777264 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1d26ad85-7d4b-4154-ac64-e9be1eae1a95 req-d41e0046-7f70-4f54-bb56-ab9a209ce924 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2569065
Jun 01 06:14:34.787731 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-c6a315f3-c58e-4d72-bba3-0f9d17cf4593 req-4ea49201-07e8-4675-85a4-aec1299ebc97 service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1307616
Jun 01 06:14:34.795983 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4e214ab3-44b8-46a6-9a14-c37821f2c582 req-f3e5ab34-1eda-48ef-bc7c-bbfe2eaab3e4 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1862333
Jun 01 06:14:34.827379 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ba3db51-a6ea-457d-96fa-d0e402e681f3 req-463a289d-f472-46fe-8dd4-d1f6d0592fae tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:34.828871 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5ba3db51-a6ea-457d-96fa-d0e402e681f3 req-463a289d-f472-46fe-8dd4-d1f6d0592fae tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.48 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 945 time: 0.3872962
Jun 01 06:14:34.830031 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44e1fce5-6399-4321-9de1-0e398b7cc832 req-d80d9baf-9f5c-4d7e-9d79-b07f900b2a3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:34.831336 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-44e1fce5-6399-4321-9de1-0e398b7cc832 req-d80d9baf-9f5c-4d7e-9d79-b07f900b2a3c service neutron] 10.222.0.48 "GET /v2.0/networks?id=6e45a0e5-f930-4b18-8f4f-1693815eb31a HTTP/1.1" status: 200  len: 919 time: 0.3375764
Jun 01 06:14:34.963424 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-c6a315f3-c58e-4d72-bba3-0f9d17cf4593 req-3f1e46d7-8109-4203-94ae-ba16870904da service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1683960
Jun 01 06:14:34.987154 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-44e1fce5-6399-4321-9de1-0e398b7cc832 req-27d61841-c6dc-4d15-b117-2140eabdfcfe service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5f320f89-ada2-472d-b9ac-0676b4c4b578 HTTP/1.1" status: 200  len: 217 time: 0.1437662
Jun 01 06:14:35.094118 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-64814dad-4fe7-4191-aa60-9e44ee00d731 req-d372ed0f-0fc1-4c3b-aaf8-e7347efced93 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 210 time: 0.1004205
Jun 01 06:14:35.181776 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44e1fce5-6399-4321-9de1-0e398b7cc832 req-1baa8747-9e48-4897-9343-d60dcb8b6089 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:35.183510 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-44e1fce5-6399-4321-9de1-0e398b7cc832 req-1baa8747-9e48-4897-9343-d60dcb8b6089 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=84c296fc-69c0-46e2-b1ed-e3edf435b759 HTTP/1.1" status: 200  len: 858 time: 0.1450579
Jun 01 06:14:35.236262 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2634502-e244-45ff-a170-412e2a074bcf req-c9ee3418-e680-45db-bf7d-e73430ff4916 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:35.237776 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-e2634502-e244-45ff-a170-412e2a074bcf req-c9ee3418-e680-45db-bf7d-e73430ff4916 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.48 "GET /v2.0/networks?id=a6c6ac39-c2dd-414b-b2c1-db0b208abb9a HTTP/1.1" status: 200  len: 808 time: 0.2160740
Jun 01 06:14:35.251469 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-44e1fce5-6399-4321-9de1-0e398b7cc832 req-abb49e44-0f13-46ee-a143-083831fd49c9 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=6e45a0e5-f930-4b18-8f4f-1693815eb31a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0597436
Jun 01 06:14:35.255632 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [req-e2634502-e244-45ff-a170-412e2a074bcf req-338ec948-58b4-4650-9f56-196273a83b7a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Request body: {'port': {'device_id': '4a1dafce-1362-4f77-b3ee-1ea2dcc65db3', 'network_id': 'a6c6ac39-c2dd-414b-b2c1-db0b208abb9a', 'admin_state_up': True, 'tenant_id': 'dd97906039e7487cbb91b21981aa107c'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:14:35.293330 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-403cd2c3-eb48-4dc4-ac2c-ef43d0a5740a req-f93131ea-4ad7-47c4-bf77-46a6424ab9d6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:35.300153 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-403cd2c3-eb48-4dc4-ac2c-ef43d0a5740a req-f93131ea-4ad7-47c4-bf77-46a6424ab9d6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 944 time: 0.3638484
Jun 01 06:14:35.413076 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [req-e2634502-e244-45ff-a170-412e2a074bcf req-338ec948-58b4-4650-9f56-196273a83b7a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:14:35.417999 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-e2634502-e244-45ff-a170-412e2a074bcf req-338ec948-58b4-4650-9f56-196273a83b7a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Usage tracker for resource:port and tenant:dd97906039e7487cbb91b21981aa107c is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:14:35.421911 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-e2634502-e244-45ff-a170-412e2a074bcf req-338ec948-58b4-4650-9f56-196273a83b7a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:14:35.429290 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [req-e2634502-e244-45ff-a170-412e2a074bcf req-338ec948-58b4-4650-9f56-196273a83b7a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:14:35.436520 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-5ba3db51-a6ea-457d-96fa-d0e402e681f3 req-5673245f-8b11-400d-ae60-6fb46eedb080 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Deleting port de8f02a4-b74f-47df-a797-bc3cbe7be366 {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:14:35.436892 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-5ba3db51-a6ea-457d-96fa-d0e402e681f3 req-5673245f-8b11-400d-ae60-6fb46eedb080 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:35.440838 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e2634502-e244-45ff-a170-412e2a074bcf req-338ec948-58b4-4650-9f56-196273a83b7a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Made reservation on behalf of dd97906039e7487cbb91b21981aa107c for: {'port': 1} {{(pid=92230) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:14:35.444528 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-e2634502-e244-45ff-a170-412e2a074bcf req-338ec948-58b4-4650-9f56-196273a83b7a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:35.564402 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-403cd2c3-eb48-4dc4-ac2c-ef43d0a5740a req-8ebd1b27-5fac-4ebc-9cce-af23d58ce7c1 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2633343
Jun 01 06:14:35.623709 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-44e1fce5-6399-4321-9de1-0e398b7cc832 req-a7c45543-15ee-4e49-9036-2d8c94cf6ad0 service neutron] 10.222.0.48 "GET /v2.0/networks/6e45a0e5-f930-4b18-8f4f-1693815eb31a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3619881
Jun 01 06:14:35.631434 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_common [req-e2634502-e244-45ff-a170-412e2a074bcf req-338ec948-58b4-4650-9f56-196273a83b7a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Allocated IP 172.20.0.8 (a6c6ac39-c2dd-414b-b2c1-db0b208abb9a/c6893b02-9e5e-4658-acac-8bef895b0956/b27b14f3-a022-418f-8f09-c351f0659164) {{(pid=92230) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:14:35.747163 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d18e193-279d-46f2-8176-61b77480127d req-185d5596-1ca5-40b8-aeb0-019f100cde3e tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:35.754430 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6d18e193-279d-46f2-8176-61b77480127d req-185d5596-1ca5-40b8-aeb0-019f100cde3e tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 945 time: 0.4722631
Jun 01 06:14:35.759120 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-5ba3db51-a6ea-457d-96fa-d0e402e681f3 req-5673245f-8b11-400d-ae60-6fb46eedb080 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] For port de8f02a4-b74f-47df-a797-bc3cbe7be366, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=de8f02a4-b74f-47df-a797-bc3cbe7be366,segment=NetworkSegment(7e12089c-d8cc-429c-8b7b-f5d148a55957),segment_id=7e12089c-d8cc-429c-8b7b-f5d148a55957)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:14:35.759481 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-5ba3db51-a6ea-457d-96fa-d0e402e681f3 req-5673245f-8b11-400d-ae60-6fb46eedb080 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:36.001379 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-5ba3db51-a6ea-457d-96fa-d0e402e681f3 req-5673245f-8b11-400d-ae60-6fb46eedb080 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Calling delete_port for de8f02a4-b74f-47df-a797-bc3cbe7be366 owned by compute:nova {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:14:36.081290 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-e2634502-e244-45ff-a170-412e2a074bcf req-338ec948-58b4-4650-9f56-196273a83b7a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Notify callbacks [] for port, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:36.118750 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-e2634502-e244-45ff-a170-412e2a074bcf req-338ec948-58b4-4650-9f56-196273a83b7a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:36.126070 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-77ceb3b7-8c56-44b0-b12d-dc739da23817 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:36.136507 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6d18e193-279d-46f2-8176-61b77480127d req-c1285cb2-0e7a-4134-87e2-9a0e9bd57f31 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/security-groups?id=160af0eb-1010-4f15-828e-742d9c107c26&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3772099
Jun 01 06:14:36.161686 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-44e1fce5-6399-4321-9de1-0e398b7cc832 req-eedd95e6-e9e8-4e9c-9511-08bfaed3157b service neutron] 10.222.0.48 "GET /v2.0/networks/6e45a0e5-f930-4b18-8f4f-1693815eb31a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5244830
Jun 01 06:14:36.216312 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e2634502-e244-45ff-a170-412e2a074bcf req-338ec948-58b4-4650-9f56-196273a83b7a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Network a6c6ac39-c2dd-414b-b2c1-db0b208abb9a is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:14:36.219307 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [req-e2634502-e244-45ff-a170-412e2a074bcf req-338ec948-58b4-4650-9f56-196273a83b7a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:14:36.224013 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [req-e2634502-e244-45ff-a170-412e2a074bcf req-338ec948-58b4-4650-9f56-196273a83b7a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Received port after_create {{(pid=92230) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:14:36.254408 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-338ec948-58b4-4650-9f56-196273a83b7a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Pushing event updated for resources: {'Port': ['ID=b27b14f3-a022-418f-8f09-c351f0659164,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:36.255098 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c44f721-9735-47e7-94f0-9f40ecf22d66 req-28cf7e30-3d22-4296-b3b4-9290dd54b269 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:36.263022 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-338ec948-58b4-4650-9f56-196273a83b7a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:36.264173 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9c44f721-9735-47e7-94f0-9f40ecf22d66 req-28cf7e30-3d22-4296-b3b4-9290dd54b269 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.2333925
Jun 01 06:14:36.307194 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2634502-e244-45ff-a170-412e2a074bcf req-338ec948-58b4-4650-9f56-196273a83b7a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:36.308124 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-e2634502-e244-45ff-a170-412e2a074bcf req-338ec948-58b4-4650-9f56-196273a83b7a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:36.331108 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-e2634502-e244-45ff-a170-412e2a074bcf req-338ec948-58b4-4650-9f56-196273a83b7a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.0824809
Jun 01 06:14:36.439019 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9c44f721-9735-47e7-94f0-9f40ecf22d66 req-03b2e57b-b677-4e45-a59f-0d86b7318463 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1738532
Jun 01 06:14:36.460978 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-5ba3db51-a6ea-457d-96fa-d0e402e681f3 req-5673245f-8b11-400d-ae60-6fb46eedb080 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:36.468459 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:36.518530 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5673245f-8b11-400d-ae60-6fb46eedb080 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Pushing event deleted for resources: {'Port': ['ID=de8f02a4-b74f-47df-a797-bc3cbe7be366,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:36.521659 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-5673245f-8b11-400d-ae60-6fb46eedb080 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:36.559101 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f627c1f0-08ae-46fb-be73-073416e3f0e4 req-d3751604-9308-4542-96ad-95128ce64acc tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:36.560854 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f627c1f0-08ae-46fb-be73-073416e3f0e4 req-d3751604-9308-4542-96ad-95128ce64acc tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.2528880
Jun 01 06:14:36.751812 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-5ba3db51-a6ea-457d-96fa-d0e402e681f3 req-5673245f-8b11-400d-ae60-6fb46eedb080 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] No DVR routers for this DVR port de8f02a4-b74f-47df-a797-bc3cbe7be366 on host hv-cinder-79388 {{(pid=92229) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:14:36.759374 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-5ba3db51-a6ea-457d-96fa-d0e402e681f3 req-5673245f-8b11-400d-ae60-6fb46eedb080 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:36.762800 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5967d75f-2870-4a80-98ec-b2547cff266e', 'name': 'network-vif-deleted', 'tag': 'de8f02a4-b74f-47df-a797-bc3cbe7be366'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:14:36.765098 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ce1cc0f7-0a9d-447e-9323-b9db8e1f2a67" -d '{"events": [{"server_uuid": "5967d75f-2870-4a80-98ec-b2547cff266e", "name": "network-vif-deleted", "tag": "de8f02a4-b74f-47df-a797-bc3cbe7be366"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:14:36.794737 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5ba3db51-a6ea-457d-96fa-d0e402e681f3 req-5673245f-8b11-400d-ae60-6fb46eedb080 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.48 "DELETE /v2.0/ports/de8f02a4-b74f-47df-a797-bc3cbe7be366 HTTP/1.1" status: 204  len: 173 time: 1.9527624
Jun 01 06:14:36.817424 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f627c1f0-08ae-46fb-be73-073416e3f0e4 req-54a03ab0-010c-4206-be8a-023a0733b39a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2506812
Jun 01 06:14:36.842927 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3be84ed-1df0-4f0b-b44a-44a0db69b890 req-7348e37c-164b-4e61-8347-9c855a1d4329 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:36.844421 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b3be84ed-1df0-4f0b-b44a-44a0db69b890 req-7348e37c-164b-4e61-8347-9c855a1d4329 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 931 time: 0.1324487
Jun 01 06:14:36.904359 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-b3be84ed-1df0-4f0b-b44a-44a0db69b890 req-a8568903-e346-4ac8-b74e-17243926da76 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Synchronizing usage tracker for tenant:dd97906039e7487cbb91b21981aa107c on resource:security_group {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:14:36.958388 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-b3be84ed-1df0-4f0b-b44a-44a0db69b890 req-a8568903-e346-4ac8-b74e-17243926da76 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Unset dirty status for tenant:dd97906039e7487cbb91b21981aa107c on resource:security_group {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:14:36.959628 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b3be84ed-1df0-4f0b-b44a-44a0db69b890 req-a8568903-e346-4ac8-b74e-17243926da76 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1095774
Jun 01 06:14:37.006590 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28dae29c-2056-4aa1-9be2-11856700bcf3 req-a2cde870-d100-4e20-91e3-d803d4eee0df tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:37.008063 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-28dae29c-2056-4aa1-9be2-11856700bcf3 req-a2cde870-d100-4e20-91e3-d803d4eee0df tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 944 time: 0.0860159
Jun 01 06:14:37.032217 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:14:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b6e14f71-739f-4f9e-92ae-2d29e3aa2640 x-openstack-request-id: req-b6e14f71-739f-4f9e-92ae-2d29e3aa2640 {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:14:37.032539 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5967d75f-2870-4a80-98ec-b2547cff266e", "name": "network-vif-deleted", "tag": "de8f02a4-b74f-47df-a797-bc3cbe7be366", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:14:37.032820 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-b6e14f71-739f-4f9e-92ae-2d29e3aa2640 {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:14:37.033232 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5967d75f-2870-4a80-98ec-b2547cff266e', 'name': 'network-vif-deleted', 'tag': 'de8f02a4-b74f-47df-a797-bc3cbe7be366', 'status': 'completed', 'code': 200}
Jun 01 06:14:37.062962 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-28dae29c-2056-4aa1-9be2-11856700bcf3 req-a103e2e7-e9f3-4e27-922e-05ae1ea9c3b9 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0479410
Jun 01 06:14:37.290903 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-041f211a-8bce-4992-a6a2-90d8f1ea7a8c req-203f35f3-e397-43d4-a2f5-bb9021acabe8 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Synchronizing usage tracker for tenant:b02068c8f29e4f5e9b3c965d023f7e29 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:14:37.306028 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-041f211a-8bce-4992-a6a2-90d8f1ea7a8c req-203f35f3-e397-43d4-a2f5-bb9021acabe8 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Unset dirty status for tenant:b02068c8f29e4f5e9b3c965d023f7e29 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:14:37.308753 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-041f211a-8bce-4992-a6a2-90d8f1ea7a8c req-203f35f3-e397-43d4-a2f5-bb9021acabe8 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 210 time: 0.0623453
Jun 01 06:14:37.669035 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dacdeca-91ca-462f-a847-b88d85193b16 req-8fd858fb-de53-4071-8d8d-038b4262efc6 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:37.670703 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8dacdeca-91ca-462f-a847-b88d85193b16 req-8fd858fb-de53-4071-8d8d-038b4262efc6 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.0917878
Jun 01 06:14:37.720809 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8dacdeca-91ca-462f-a847-b88d85193b16 req-9f076038-3745-4e76-84b3-3918f561b0c1 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0442433
Jun 01 06:14:37.891920 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device de8f02a4-b74f-47df-a797-bc3cbe7be366 no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:14:37.927831 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] No Port match for: de8f02a4-b74f-47df-a797-bc3cbe7be366 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:14:37.928096 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device de8f02a4-b74f-47df-a797-bc3cbe7be366 not bound to the agent host hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:14:38.031132 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5bdd74d-f770-48c7-aaa1-ea3f903756b3 req-389a0a8f-f721-4f29-9c11-f2abb6e27b2e tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:38.032613 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e5bdd74d-f770-48c7-aaa1-ea3f903756b3 req-389a0a8f-f721-4f29-9c11-f2abb6e27b2e tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1023898
Jun 01 06:14:38.088310 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e5bdd74d-f770-48c7-aaa1-ea3f903756b3 req-60b9089f-beb0-48de-af93-17af09177754 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0496404
Jun 01 06:14:38.173262 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81ec0557-bd4d-4476-b952-b0aa09bd5a93 req-7755de9a-9ca8-4078-aa26-a771868eb3e4 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:38.180337 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-81ec0557-bd4d-4476-b952-b0aa09bd5a93 req-7755de9a-9ca8-4078-aa26-a771868eb3e4 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 931 time: 0.0899348
Jun 01 06:14:38.262678 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-81ec0557-bd4d-4476-b952-b0aa09bd5a93 req-b579953c-da1f-4378-9212-6083b815c02b tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0814579
Jun 01 06:14:38.317345 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59ef39e2-1c1a-4984-aba4-734d0ef1bd4f req-c0b1d04b-5f82-4c69-a087-906bc780bec8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:38.318846 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-59ef39e2-1c1a-4984-aba4-734d0ef1bd4f req-c0b1d04b-5f82-4c69-a087-906bc780bec8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 944 time: 0.1068034
Jun 01 06:14:38.329518 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-522075cd-45ed-41ec-bde6-c60bb0cf13fb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:38.378134 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-59ef39e2-1c1a-4984-aba4-734d0ef1bd4f req-853ce571-a9e1-4dae-b58a-87b9b1c91e3a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0510235
Jun 01 06:14:38.506609 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-dfecf3ff-fccc-47dc-91d6-0e3e5b6a1f9d req-451f8d8b-bc93-453b-b8bc-9a84938d213c tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 210 time: 0.0497789
Jun 01 06:14:38.930087 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b851234f-955f-4262-9c01-602daa24ad24 req-ec4f048d-88ae-4061-88d4-0537da5f8605 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:38.931581 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b851234f-955f-4262-9c01-602daa24ad24 req-ec4f048d-88ae-4061-88d4-0537da5f8605 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.0876608
Jun 01 06:14:38.981083 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b851234f-955f-4262-9c01-602daa24ad24 req-d2be90fe-0eba-44a4-bd34-6364a8cf1f99 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0430703
Jun 01 06:14:39.297210 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7220222-064a-4d84-94ea-2d5a6db99d2e req-a61e4fce-9a07-4eab-843e-47f021190c62 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:39.299726 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b7220222-064a-4d84-94ea-2d5a6db99d2e req-a61e4fce-9a07-4eab-843e-47f021190c62 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1021297
Jun 01 06:14:39.352107 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b7220222-064a-4d84-94ea-2d5a6db99d2e req-9b067f3f-dca7-473c-b537-8a95119332fd tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0471449
Jun 01 06:14:39.471214 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19eed989-c818-4de0-982f-2bee4f18f43c req-dff3d3ea-4064-403f-8f24-824ee5c89a73 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:39.473033 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-19eed989-c818-4de0-982f-2bee4f18f43c req-dff3d3ea-4064-403f-8f24-824ee5c89a73 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 931 time: 0.0973277
Jun 01 06:14:39.566555 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-19eed989-c818-4de0-982f-2bee4f18f43c req-00979b5a-6bf3-4808-bde5-7e16717ac803 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0875893
Jun 01 06:14:39.609988 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67d30e0d-6484-44d1-9f5b-0e807be4395c req-b4a6d6eb-6716-4f4c-83c9-244e408059c0 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:39.611521 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-67d30e0d-6484-44d1-9f5b-0e807be4395c req-b4a6d6eb-6716-4f4c-83c9-244e408059c0 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 944 time: 0.1042111
Jun 01 06:14:39.672606 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-67d30e0d-6484-44d1-9f5b-0e807be4395c req-404c02f6-9491-4d17-9e94-98b416a904a7 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0549536
Jun 01 06:14:39.743530 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4d1ed21f-a29c-4351-862e-c0a52f362e04 req-d915fa28-b409-462f-a9c9-33cd96251c0b tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 210 time: 0.0441997
Jun 01 06:14:40.184765 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-304790fd-2ed8-4575-9d19-4d46e624f57f req-db7aa61e-17cc-4050-ae86-3c0c12f53cf5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:40.186242 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-304790fd-2ed8-4575-9d19-4d46e624f57f req-db7aa61e-17cc-4050-ae86-3c0c12f53cf5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.0848053
Jun 01 06:14:40.236840 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-304790fd-2ed8-4575-9d19-4d46e624f57f req-869d700b-53a0-4e17-b8f7-b5aa0468ebd8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0447996
Jun 01 06:14:40.548531 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a528835-6b58-4aa0-b6bf-b9b6b80040c9 req-8dedcad9-1c04-4137-9155-89b1878379ab tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:40.550010 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0a528835-6b58-4aa0-b6bf-b9b6b80040c9 req-8dedcad9-1c04-4137-9155-89b1878379ab tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.0834999
Jun 01 06:14:40.597413 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0a528835-6b58-4aa0-b6bf-b9b6b80040c9 req-bf74fa75-f8f6-4751-a44a-8d55656be634 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0415342
Jun 01 06:14:40.769679 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72bbff15-4649-435c-adfd-4cc849e13e65 req-f3bfc527-4f50-429a-8fbe-1f5aed894ad8 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:40.771115 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-72bbff15-4649-435c-adfd-4cc849e13e65 req-f3bfc527-4f50-429a-8fbe-1f5aed894ad8 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 931 time: 0.0939448
Jun 01 06:14:40.868379 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-72bbff15-4649-435c-adfd-4cc849e13e65 req-7ecfde59-431b-4304-8189-1e3d8ce0a48d tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0904665
Jun 01 06:14:40.899824 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e2648c9-0214-46d5-82ea-e3cb124fd88a req-593d020b-4615-4016-b095-441fa277759f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:40.902331 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1e2648c9-0214-46d5-82ea-e3cb124fd88a req-593d020b-4615-4016-b095-441fa277759f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 944 time: 0.1084721
Jun 01 06:14:40.951383 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1e2648c9-0214-46d5-82ea-e3cb124fd88a req-25d76c73-17b8-421c-99ac-6669b884e3d8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0426400
Jun 01 06:14:41.028010 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-97f065ed-23d1-456b-9d08-d335500345bd req-b2fa7ed0-010b-4428-84a3-a136a0b92384 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 210 time: 0.0464067
Jun 01 06:14:41.215246 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:41.443611 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca9b27eb-0014-4901-bd76-df9a148fbbdf req-b6f8bf68-9f15-45fc-a01e-1e7bcfaeea83 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:41.445721 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ca9b27eb-0014-4901-bd76-df9a148fbbdf req-b6f8bf68-9f15-45fc-a01e-1e7bcfaeea83 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.0914111
Jun 01 06:14:41.515554 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ca9b27eb-0014-4901-bd76-df9a148fbbdf req-9ce52075-eafd-42b6-a8cb-528e46990153 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0626321
Jun 01 06:14:41.862996 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff2bd4b3-3406-47e6-abd9-211a040e669e req-890b3bb7-4a2d-4201-9cf0-dacf94da80ca tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:41.864516 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ff2bd4b3-3406-47e6-abd9-211a040e669e req-890b3bb7-4a2d-4201-9cf0-dacf94da80ca tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1467230
Jun 01 06:14:41.911915 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ff2bd4b3-3406-47e6-abd9-211a040e669e req-6c749964-4c57-450d-85da-a96aae612457 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408363
Jun 01 06:14:42.138506 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea6b3a4b-0cd9-4e59-98d2-bae3dafb0f5c req-0315bf8f-69d9-433f-80bf-d77310a6d96c tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:42.140028 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ea6b3a4b-0cd9-4e59-98d2-bae3dafb0f5c req-0315bf8f-69d9-433f-80bf-d77310a6d96c tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 931 time: 0.1495521
Jun 01 06:14:42.196831 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d00df0a-576b-4792-aaa1-edcbf27624ac req-8f23250c-ce04-4c09-954e-47677e9f20e4 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:42.198877 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7d00df0a-576b-4792-aaa1-edcbf27624ac req-8f23250c-ce04-4c09-954e-47677e9f20e4 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 944 time: 0.1315017
Jun 01 06:14:42.207568 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ea6b3a4b-0cd9-4e59-98d2-bae3dafb0f5c req-f088be2c-b769-48d2-85ee-7e74787bc6d4 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0604959
Jun 01 06:14:42.253559 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7d00df0a-576b-4792-aaa1-edcbf27624ac req-e1cbbb43-24c9-4036-9db7-36707d54d68c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0452638
Jun 01 06:14:42.345811 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-a5c2954d-0922-4036-81f4-80dffaebb721 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:42.374839 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c396250d-d9ca-4e6c-bead-697a7b550acb req-4863aa8d-035d-4c6d-877f-d021f29beb83 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 210 time: 0.0554082
Jun 01 06:14:42.732639 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e62ec4b-dda3-4ece-bdd3-2b6f853f1165 req-987879c8-364d-4404-8c81-6b85f080b6d8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:42.734026 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7e62ec4b-dda3-4ece-bdd3-2b6f853f1165 req-987879c8-364d-4404-8c81-6b85f080b6d8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.1015449
Jun 01 06:14:42.786348 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7e62ec4b-dda3-4ece-bdd3-2b6f853f1165 req-eea7bd08-8965-4693-b809-038d97d7c1a8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0465245
Jun 01 06:14:43.102503 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1209250-46b7-4065-a804-f85d914f3dea req-1584febf-59fc-40b4-a376-51625ea502e7 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:43.104073 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a1209250-46b7-4065-a804-f85d914f3dea req-1584febf-59fc-40b4-a376-51625ea502e7 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.0834877
Jun 01 06:14:43.149487 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a1209250-46b7-4065-a804-f85d914f3dea req-d720fb79-1650-4faf-b004-1eff9fcdf4a5 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398741
Jun 01 06:14:43.257185 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:43.480743 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba711295-0454-4c63-a423-9242cf14be13 req-261475b8-36a7-4602-aba1-c51a77858b88 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:43.482183 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ba711295-0454-4c63-a423-9242cf14be13 req-261475b8-36a7-4602-aba1-c51a77858b88 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 931 time: 0.1564040
Jun 01 06:14:43.510792 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fbcd9ca-1508-401d-84cc-f6a8b7b0dc7e req-ae84980d-b85c-49af-97e1-23ada4d6562d tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:43.512363 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0fbcd9ca-1508-401d-84cc-f6a8b7b0dc7e req-ae84980d-b85c-49af-97e1-23ada4d6562d tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 944 time: 0.1193278
Jun 01 06:14:43.565152 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ba711295-0454-4c63-a423-9242cf14be13 req-d37b63bf-d28b-42b5-a429-b1d1186c80f9 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0750489
Jun 01 06:14:43.579027 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0fbcd9ca-1508-401d-84cc-f6a8b7b0dc7e req-071f2d20-ca5d-41bb-9ea7-602d6cedd293 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0584924
Jun 01 06:14:43.718489 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1bb40291-31a2-426f-ba1d-a61b44a50743 req-425a8ac6-9f0e-4081-9f22-4da0a2614fcf tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 210 time: 0.0477359
Jun 01 06:14:43.986118 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f653cefa-2677-46a8-8bea-20d8ad468473 req-88eea801-9708-4d25-ba31-24c63a803183 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:43.988210 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f653cefa-2677-46a8-8bea-20d8ad468473 req-88eea801-9708-4d25-ba31-24c63a803183 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.0830245
Jun 01 06:14:44.047997 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f653cefa-2677-46a8-8bea-20d8ad468473 req-7f89e59e-75cd-43d7-8333-50e59f29d12e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0525625
Jun 01 06:14:44.368102 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24356516-f1a4-437e-a09a-11e70597d381 req-7ce399eb-6c54-4a39-8989-1ba89e3d9354 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:44.370184 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-24356516-f1a4-437e-a09a-11e70597d381 req-7ce399eb-6c54-4a39-8989-1ba89e3d9354 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1131725
Jun 01 06:14:44.416285 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-24356516-f1a4-437e-a09a-11e70597d381 req-2650bb21-8ae3-4dd1-bd6f-1549fa0447fe tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0401602
Jun 01 06:14:44.824864 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb5c6e04-7b19-466c-af26-4a6cd6391da4 req-9fcade85-b8aa-4539-9b0a-4a52f88e8029 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:44.826503 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-eb5c6e04-7b19-466c-af26-4a6cd6391da4 req-9fcade85-b8aa-4539-9b0a-4a52f88e8029 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 931 time: 0.1457622
Jun 01 06:14:44.843795 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d3ba9ea-3db3-40b7-9438-11463290ecdd req-0cc551aa-d83c-4a03-92d5-7f6194a645b7 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:44.845212 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3d3ba9ea-3db3-40b7-9438-11463290ecdd req-0cc551aa-d83c-4a03-92d5-7f6194a645b7 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 944 time: 0.1325223
Jun 01 06:14:44.918665 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-eb5c6e04-7b19-466c-af26-4a6cd6391da4 req-92b2c434-a35a-45a6-984f-fed5b159f06e tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0851269
Jun 01 06:14:44.923307 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3d3ba9ea-3db3-40b7-9438-11463290ecdd req-2f261c11-96e5-4e62-ba3f-d40ee27ff002 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0644977
Jun 01 06:14:45.106103 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8f65e83c-62e0-4010-a55a-7f78e38ca318 req-862c1e2c-1485-4eed-a482-3d056c294c82 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 210 time: 0.0565138
Jun 01 06:14:45.279552 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01c49be2-7c78-4176-ac03-d59a2fe02490 req-baac04a3-2c8c-4087-aa34-b1ddf274982d tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:45.282345 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-01c49be2-7c78-4176-ac03-d59a2fe02490 req-baac04a3-2c8c-4087-aa34-b1ddf274982d tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.1106455
Jun 01 06:14:45.341311 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-01c49be2-7c78-4176-ac03-d59a2fe02490 req-fa52d039-010c-4d24-82cc-90226a1bfdf9 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0536959
Jun 01 06:14:45.373857 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:45.647406 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac613ea7-c7dd-445b-abc5-b73b21cdaa47 req-255e063f-0d42-40ba-b32d-030b667ad319 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:45.649002 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ac613ea7-c7dd-445b-abc5-b73b21cdaa47 req-255e063f-0d42-40ba-b32d-030b667ad319 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1188064
Jun 01 06:14:45.701716 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ac613ea7-c7dd-445b-abc5-b73b21cdaa47 req-73db7914-82e6-4220-8747-c1d6a832928f tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0455930
Jun 01 06:14:45.975530 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:46.130380 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72b7c4fe-8f5c-4a8f-addf-9194d4af2c83 req-bb00d59c-01b5-421a-850b-46186d4d8448 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:46.131939 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-72b7c4fe-8f5c-4a8f-addf-9194d4af2c83 req-bb00d59c-01b5-421a-850b-46186d4d8448 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 931 time: 0.0903990
Jun 01 06:14:46.184339 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-72b7c4fe-8f5c-4a8f-addf-9194d4af2c83 req-3a54d3d2-4a26-436a-b73e-f659c948da9c tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0435207
Jun 01 06:14:46.386280 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc57e29d-f4ca-483b-9c4f-64a653833e07 req-9c7dec1c-b928-427c-8bbf-7f574d1b8728 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:46.387834 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fc57e29d-f4ca-483b-9c4f-64a653833e07 req-9c7dec1c-b928-427c-8bbf-7f574d1b8728 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 944 time: 0.0930035
Jun 01 06:14:46.439041 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fc57e29d-f4ca-483b-9c4f-64a653833e07 req-bcd8ec7e-0e03-4974-a06c-33bf682c9f85 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0454299
Jun 01 06:14:46.617717 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6d64d467-0c0f-40e9-a02b-e385003be0bd req-e2281309-e002-46d9-8119-347306a9e762 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 210 time: 0.0701232
Jun 01 06:14:46.977695 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-370f4d43-3c0d-4e89-8272-f9782c69cc56 req-c0478c5b-2ff1-4e95-88cd-f54782dd1c3f tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:46.979672 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-370f4d43-3c0d-4e89-8272-f9782c69cc56 req-c0478c5b-2ff1-4e95-88cd-f54782dd1c3f tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.2145383
Jun 01 06:14:47.021526 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69946c61-eb38-4efb-bd7f-fbb8f813b47d req-f61f2899-1595-42d1-9f73-1a8b62404c72 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:47.024221 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-69946c61-eb38-4efb-bd7f-fbb8f813b47d req-f61f2899-1595-42d1-9f73-1a8b62404c72 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1951294
Jun 01 06:14:47.062920 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-370f4d43-3c0d-4e89-8272-f9782c69cc56 req-9edb3dbd-0afb-4d79-badd-548cb86dd2a5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0762773
Jun 01 06:14:47.086488 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-69946c61-eb38-4efb-bd7f-fbb8f813b47d req-74b865b5-e030-470c-b3ac-2c724984e3b8 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0538228
Jun 01 06:14:47.376826 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41720d69-7dda-4e12-8b2d-b5a8c4cc539b req-2f3ada88-347d-4ae1-b54d-32791376b863 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:47.378261 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-41720d69-7dda-4e12-8b2d-b5a8c4cc539b req-2f3ada88-347d-4ae1-b54d-32791376b863 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 931 time: 0.0853803
Jun 01 06:14:47.425968 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-41720d69-7dda-4e12-8b2d-b5a8c4cc539b req-7a44162c-b64d-454c-be41-ddc08438e23a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0420909
Jun 01 06:14:47.657382 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7e72c67-e624-4dce-98ce-b776d82c7893 req-8f816e20-ca59-40be-990b-c19cb34c0c73 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:47.659230 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e7e72c67-e624-4dce-98ce-b776d82c7893 req-8f816e20-ca59-40be-990b-c19cb34c0c73 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 944 time: 0.0939171
Jun 01 06:14:47.705715 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e7e72c67-e624-4dce-98ce-b776d82c7893 req-47877696-e9b0-4be7-a4fa-a80189038f27 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0409226
Jun 01 06:14:47.788853 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bbbf22d0-501b-467e-bc4e-5557d594d1e2 req-a716eea7-3371-4d68-9f14-d1dc9f5a2ec7 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 210 time: 0.0449221
Jun 01 06:14:48.313833 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6508d77-bf7b-4d54-a724-95d4bedd9213 req-0390aebd-6503-486a-96b8-7ee32ce313b0 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:48.315731 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f6508d77-bf7b-4d54-a724-95d4bedd9213 req-0390aebd-6503-486a-96b8-7ee32ce313b0 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.1427486
Jun 01 06:14:48.323720 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e287a1f-e849-4388-a8cf-cd43fc868f56 req-a29d3bec-4d46-4b0b-b746-c7962faeea9f tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:48.325231 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5e287a1f-e849-4388-a8cf-cd43fc868f56 req-a29d3bec-4d46-4b0b-b746-c7962faeea9f tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1209443
Jun 01 06:14:48.400216 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [req-e2634502-e244-45ff-a170-412e2a074bcf req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Request body: {'port': {'device_id': '4a1dafce-1362-4f77-b3ee-1ea2dcc65db3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79388'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:14:48.403492 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f6508d77-bf7b-4d54-a724-95d4bedd9213 req-5d14a5f7-29ca-4ea8-815c-6033373bf941 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0773261
Jun 01 06:14:48.422047 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5e287a1f-e849-4388-a8cf-cd43fc868f56 req-2b76752d-d2e1-4120-830b-6be49490895e tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0789020
Jun 01 06:14:48.533686 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-e2634502-e244-45ff-a170-412e2a074bcf req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:48.782972 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1235722a-8a6d-49e3-9d5f-24d6f79d8884 req-519ae6b2-9489-49f3-9a19-63f130f77739 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:48.784478 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1235722a-8a6d-49e3-9d5f-24d6f79d8884 req-519ae6b2-9489-49f3-9a19-63f130f77739 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=0f63ca6fed3e47a6a676979240aef5c0&device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 1096 time: 0.1596406
Jun 01 06:14:48.805661 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff288cb7-5a14-4380-aacb-e4861a840c0b req-5e6035b4-8e56-4cd6-9054-9a702ddbdfd6 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:48.808066 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ff288cb7-5a14-4380-aacb-e4861a840c0b req-5e6035b4-8e56-4cd6-9054-9a702ddbdfd6 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 931 time: 0.2319741
Jun 01 06:14:48.973403 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.notifiers.nova [req-e2634502-e244-45ff-a170-412e2a074bcf req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b27b14f3-a022-418f-8f09-c351f0659164 {{(pid=92230) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:14:48.981065 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-e2634502-e244-45ff-a170-412e2a074bcf req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:48.996375 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.provisioning_blocks [req-e2634502-e244-45ff-a170-412e2a074bcf req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Transition to ACTIVE for port object b27b14f3-a022-418f-8f09-c351f0659164 will not be triggered until provisioned by entity L2. {{(pid=92230) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:14:49.000487 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-e2634502-e244-45ff-a170-412e2a074bcf req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2416196'] for port, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:49.004545 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ff288cb7-5a14-4380-aacb-e4861a840c0b req-361eb5d4-a931-456d-8ff0-90dae24cae6d tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1900182
Jun 01 06:14:49.005839 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:49.063598 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e778201-892b-434d-a725-0c563d02c76f req-b5e29ad1-8fa2-464e-8119-0677204cb40c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:49.070601 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2e778201-892b-434d-a725-0c563d02c76f req-b5e29ad1-8fa2-464e-8119-0677204cb40c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 944 time: 0.2144313
Jun 01 06:14:49.074169 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1235722a-8a6d-49e3-9d5f-24d6f79d8884 req-53231fd1-9af8-440a-8243-ff2bec73c347 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:49.075530 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1235722a-8a6d-49e3-9d5f-24d6f79d8884 req-53231fd1-9af8-440a-8243-ff2bec73c347 service neutron] 10.222.0.48 "GET /v2.0/networks?id=5f973ed4-521b-4b78-9a54-1336b1302fa2 HTTP/1.1" status: 200  len: 917 time: 0.2456589
Jun 01 06:14:49.235808 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Pushing event updated for resources: {'Port': ['ID=b27b14f3-a022-418f-8f09-c351f0659164,revision_number=2']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:49.239070 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0dcbdf76-ce44-4d54-9cc4-1d05700d07ec req-83b12678-1d5e-4f49-ae13-b9d010aff2d1 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] 10.222.0.25 "GET /v2.0/ports?device_id=5967d75f-2870-4a80-98ec-b2547cff266e HTTP/1.1" status: 200  len: 210 time: 0.0780432
Jun 01 06:14:49.243632 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.238s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:49.251990 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2e778201-892b-434d-a725-0c563d02c76f req-45851c5d-fc93-46fe-baf2-bf490155d0c5 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1803169
Jun 01 06:14:49.265405 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1235722a-8a6d-49e3-9d5f-24d6f79d8884 req-57a66bf1-9848-4a96-80b9-9818f93a2be2 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=826848c6-a93a-4712-82dd-39e403bcb79e HTTP/1.1" status: 200  len: 999 time: 0.1775467
Jun 01 06:14:49.274779 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.managers [req-e2634502-e244-45ff-a170-412e2a074bcf req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Attempting to bind port b27b14f3-a022-418f-8f09-c351f0659164 on host hv-cinder-79388 for vnic_type normal with profile  {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:14:49.275107 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.managers [req-e2634502-e244-45ff-a170-412e2a074bcf req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Attempting to bind port b27b14f3-a022-418f-8f09-c351f0659164 by drivers openvswitch,hyperv on host hv-cinder-79388 at level 0 using segments [{'id': 'c333deab-77ad-4250-916e-537423452613', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 236, 'network_id': 'a6c6ac39-c2dd-414b-b2c1-db0b208abb9a'}] {{(pid=92230) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:14:49.275419 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2634502-e244-45ff-a170-412e2a074bcf req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Attempting to bind port b27b14f3-a022-418f-8f09-c351f0659164 on network a6c6ac39-c2dd-414b-b2c1-db0b208abb9a {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:14:49.281031 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2634502-e244-45ff-a170-412e2a074bcf req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Port b27b14f3-a022-418f-8f09-c351f0659164 on network a6c6ac39-c2dd-414b-b2c1-db0b208abb9a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79388 {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 06:14:49.281348 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2634502-e244-45ff-a170-412e2a074bcf req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Attempting to bind port b27b14f3-a022-418f-8f09-c351f0659164 on network a6c6ac39-c2dd-414b-b2c1-db0b208abb9a {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:14:49.286435 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2634502-e244-45ff-a170-412e2a074bcf req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Checking agent: {'id': '56148394-2131-4d06-bcfa-c032301591b8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79388', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'started_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 14, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:14:49.286771 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2634502-e244-45ff-a170-412e2a074bcf req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Checking segment: {'id': 'c333deab-77ad-4250-916e-537423452613', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 236, 'network_id': 'a6c6ac39-c2dd-414b-b2c1-db0b208abb9a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92230) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:14:49.287144 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2634502-e244-45ff-a170-412e2a074bcf req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Bound using segment: {'id': 'c333deab-77ad-4250-916e-537423452613', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 236, 'network_id': 'a6c6ac39-c2dd-414b-b2c1-db0b208abb9a'} {{(pid=92230) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:14:49.287563 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.managers [req-e2634502-e244-45ff-a170-412e2a074bcf req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Bound port: b27b14f3-a022-418f-8f09-c351f0659164, host: hv-cinder-79388, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c333deab-77ad-4250-916e-537423452613', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 236, 'network_id': 'a6c6ac39-c2dd-414b-b2c1-db0b208abb9a'}}] {{(pid=92230) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:14:49.287949 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-e2634502-e244-45ff-a170-412e2a074bcf req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:49.333034 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1235722a-8a6d-49e3-9d5f-24d6f79d8884 req-0df4b764-81d4-4aa9-a903-f9c60b901b54 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:49.334528 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1235722a-8a6d-49e3-9d5f-24d6f79d8884 req-0df4b764-81d4-4aa9-a903-f9c60b901b54 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=6137ee10-ce13-45c9-8edb-31811502bfd7 HTTP/1.1" status: 200  len: 855 time: 0.0608344
Jun 01 06:14:49.384789 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [req-e2634502-e244-45ff-a170-412e2a074bcf req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] For port b27b14f3-a022-418f-8f09-c351f0659164, host hv-cinder-79388, cleared binding levels {{(pid=92230) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:14:49.389177 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [req-e2634502-e244-45ff-a170-412e2a074bcf req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] For port b27b14f3-a022-418f-8f09-c351f0659164, host hv-cinder-79388, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=b27b14f3-a022-418f-8f09-c351f0659164,segment=NetworkSegment(c333deab-77ad-4250-916e-537423452613),segment_id=c333deab-77ad-4250-916e-537423452613)] {{(pid=92230) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:14:49.393766 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-e2634502-e244-45ff-a170-412e2a074bcf req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2416196'] for port, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:49.398714 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-69b3bdb6-a68e-412f-ac99-3cdbaab5bcd2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:49.420449 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1235722a-8a6d-49e3-9d5f-24d6f79d8884 req-8b1713c6-e41e-4e98-a963-bc9272e6f3e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:49.422247 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1235722a-8a6d-49e3-9d5f-24d6f79d8884 req-8b1713c6-e41e-4e98-a963-bc9272e6f3e4 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=5f973ed4-521b-4b78-9a54-1336b1302fa2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0796115
Jun 01 06:14:49.459681 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2634502-e244-45ff-a170-412e2a074bcf req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:49.460867 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-e2634502-e244-45ff-a170-412e2a074bcf req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:49.462160 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-e2634502-e244-45ff-a170-412e2a074bcf req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] 10.222.0.48 "PUT /v2.0/ports/b27b14f3-a022-418f-8f09-c351f0659164 HTTP/1.1" status: 200  len: 1093 time: 1.0694318
Jun 01 06:14:49.462764 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4a1dafce-1362-4f77-b3ee-1ea2dcc65db3', 'tag': 'b27b14f3-a022-418f-8f09-c351f0659164'}] {{(pid=92230) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:14:49.465240 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a8971187fdc179bafebfda031591b22633150c3ea1d9449252a7819502f19756" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1499895f-25ce-430a-bffd-e84a58af6ad7" -d '{"events": [{"name": "network-changed", "server_uuid": "4a1dafce-1362-4f77-b3ee-1ea2dcc65db3", "tag": "b27b14f3-a022-418f-8f09-c351f0659164"}]}' {{(pid=92230) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:14:49.486399 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Pushing event updated for resources: {'Port': ['ID=b27b14f3-a022-418f-8f09-c351f0659164,revision_number=3']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:49.490039 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:49.630811 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2634502-e244-45ff-a170-412e2a074bcf req-48c047cd-1d5c-4643-9575-8917ba924e8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:49.633009 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-e2634502-e244-45ff-a170-412e2a074bcf req-48c047cd-1d5c-4643-9575-8917ba924e8e service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=dd97906039e7487cbb91b21981aa107c&device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 1096 time: 0.1063495
Jun 01 06:14:49.716854 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-e2634502-e244-45ff-a170-412e2a074bcf req-673eaca2-0e36-47bb-936e-bcde0bdd606b service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b27b14f3-a022-418f-8f09-c351f0659164 HTTP/1.1" status: 200  len: 217 time: 0.0721674
Jun 01 06:14:49.752424 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1235722a-8a6d-49e3-9d5f-24d6f79d8884 req-8081dda9-f210-4917-9adb-c2ca96109386 service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3229115
Jun 01 06:14:49.784044 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2634502-e244-45ff-a170-412e2a074bcf req-b1b0e98e-a2e5-4422-a88f-526b13eba75c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:49.785468 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-e2634502-e244-45ff-a170-412e2a074bcf req-b1b0e98e-a2e5-4422-a88f-526b13eba75c service neutron] 10.222.0.48 "GET /v2.0/subnets?id=c6893b02-9e5e-4658-acac-8bef895b0956 HTTP/1.1" status: 200  len: 848 time: 0.0617630
Jun 01 06:14:49.797628 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0311c2d-a51e-45ed-b186-d42165b4cbcb req-e63aa326-c2b4-47fa-9f95-8097b696f605 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:49.799101 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c0311c2d-a51e-45ed-b186-d42165b4cbcb req-e63aa326-c2b4-47fa-9f95-8097b696f605 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.2224715
Jun 01 06:14:49.836215 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-e2634502-e244-45ff-a170-412e2a074bcf req-8ca384dd-27b0-44f5-8ea2-6fa5ae242025 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=a6c6ac39-c2dd-414b-b2c1-db0b208abb9a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0436110
Jun 01 06:14:49.965959 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de46107d-47cf-4dd4-a918-11cd5e46f472 req-716b6f08-ed27-4cd0-9982-016d506d08eb tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:49.967316 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-de46107d-47cf-4dd4-a918-11cd5e46f472 req-716b6f08-ed27-4cd0-9982-016d506d08eb tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.3387434
Jun 01 06:14:49.974680 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-e2634502-e244-45ff-a170-412e2a074bcf req-47e435ea-7c06-4215-9b36-360f658ba424 service neutron] 10.222.0.48 "GET /v2.0/networks/a6c6ac39-c2dd-414b-b2c1-db0b208abb9a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1308401
Jun 01 06:14:50.005570 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 7d7451f5-3439-4d43-8bf7-ac121c8931c4 details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:14:50.039190 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c0311c2d-a51e-45ed-b186-d42165b4cbcb req-f159c64d-df40-4c9a-8193-a5a2a1dff93a tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1025550
Jun 01 06:14:50.076230 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-de46107d-47cf-4dd4-a918-11cd5e46f472 req-1a1b0b3d-ff0d-41eb-9dd7-0ba0f3baca5f tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0986264
Jun 01 06:14:50.082221 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1235722a-8a6d-49e3-9d5f-24d6f79d8884 req-5e8f2c78-882d-490b-98af-5258d533dc05 service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3188896
Jun 01 06:14:50.171647 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:14:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-27f6b46a-772b-47af-9be3-61d238292705 x-openstack-request-id: req-27f6b46a-772b-47af-9be3-61d238292705 {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:14:50.172201 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4a1dafce-1362-4f77-b3ee-1ea2dcc65db3", "tag": "b27b14f3-a022-418f-8f09-c351f0659164", "status": "completed", "code": 200}]} {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:14:50.172574 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-27f6b46a-772b-47af-9be3-61d238292705 {{(pid=92230) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:14:50.173087 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4a1dafce-1362-4f77-b3ee-1ea2dcc65db3', 'tag': 'b27b14f3-a022-418f-8f09-c351f0659164', 'status': 'completed', 'code': 200}
Jun 01 06:14:50.223539 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 7d7451f5-3439-4d43-8bf7-ac121c8931c4, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=7d7451f5-3439-4d43-8bf7-ac121c8931c4,segment=NetworkSegment(e9a368be-e119-4f56-bdcc-b9d10543e0d8),segment_id=e9a368be-e119-4f56-bdcc-b9d10543e0d8)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:14:50.235505 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-e2634502-e244-45ff-a170-412e2a074bcf req-ff7883ba-53d7-46f1-b36e-76d582f5de72 service neutron] 10.222.0.48 "GET /v2.0/networks/a6c6ac39-c2dd-414b-b2c1-db0b208abb9a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2526989
Jun 01 06:14:50.259380 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': '7d7451f5-3439-4d43-8bf7-ac121c8931c4', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'port_id': '7d7451f5-3439-4d43-8bf7-ac121c8931c4', 'mac_address': 'fa:16:3e:70:80:f8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 209, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:14:50.366413 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-212fd660-c63d-46ae-a418-1202b966ed17 req-cac129fa-102f-427c-8c35-14db7f722bf5 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:50.377200 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-212fd660-c63d-46ae-a418-1202b966ed17 req-cac129fa-102f-427c-8c35-14db7f722bf5 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 943 time: 0.1360991
Jun 01 06:14:50.383232 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1499895f-25ce-430a-bffd-e84a58af6ad7 req-2b2b09b5-2170-4c6e-a7e3-5f8316727680 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:50.385055 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-1499895f-25ce-430a-bffd-e84a58af6ad7 req-2b2b09b5-2170-4c6e-a7e3-5f8316727680 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=dd97906039e7487cbb91b21981aa107c&device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 1096 time: 0.0857151
Jun 01 06:14:50.435212 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:50.453603 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7d7451f5-3439-4d43-8bf7-ac121c8931c4 {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:14:50.471488 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 7d7451f5-3439-4d43-8bf7-ac121c8931c4, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=7d7451f5-3439-4d43-8bf7-ac121c8931c4,segment=NetworkSegment(e9a368be-e119-4f56-bdcc-b9d10543e0d8),segment_id=e9a368be-e119-4f56-bdcc-b9d10543e0d8)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:14:50.476754 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:50.480002 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:50.511539 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-212fd660-c63d-46ae-a418-1202b966ed17 req-6675cc7b-3974-4a60-8588-d7158af30867 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1303670
Jun 01 06:14:50.541910 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1499895f-25ce-430a-bffd-e84a58af6ad7 req-e891b599-9051-49f4-a334-9555753ade81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:50.543601 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-1499895f-25ce-430a-bffd-e84a58af6ad7 req-e891b599-9051-49f4-a334-9555753ade81 service neutron] 10.222.0.48 "GET /v2.0/networks?id=a6c6ac39-c2dd-414b-b2c1-db0b208abb9a HTTP/1.1" status: 200  len: 909 time: 0.1517718
Jun 01 06:14:50.556981 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-832851ca-3caf-4ab6-a2db-9e71b51ff77b req-c558f218-fb00-4311-a555-d69c75314190 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:50.566214 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-832851ca-3caf-4ab6-a2db-9e71b51ff77b req-c558f218-fb00-4311-a555-d69c75314190 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 944 time: 0.1720502
Jun 01 06:14:50.612180 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=7d7451f5-3439-4d43-8bf7-ac121c8931c4,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:50.617768 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:50.627969 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-832851ca-3caf-4ab6-a2db-9e71b51ff77b req-b0d501f6-fc86-4c23-a2d4-d16c13cb8487 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0581977
Jun 01 06:14:50.632346 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 35952) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:14:50.666151 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-1499895f-25ce-430a-bffd-e84a58af6ad7 req-541ae4b3-836d-46ad-9b12-8658bbe271f1 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b27b14f3-a022-418f-8f09-c351f0659164 HTTP/1.1" status: 200  len: 217 time: 0.1095500
Jun 01 06:14:50.708097 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_v2 [None req-d09b87e1-90c9-4401-83d4-24b7b7e866f9 admin admin] Deleting subnet 52a5c0c8-e902-4e55-bfa8-495f043331da {{(pid=92229) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 06:14:50.711660 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d09b87e1-90c9-4401-83d4-24b7b7e866f9 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:50.734893 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1499895f-25ce-430a-bffd-e84a58af6ad7 req-fef74c7a-d8b9-4f0e-8d6a-5cf3be0d3394 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:50.736252 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-1499895f-25ce-430a-bffd-e84a58af6ad7 req-fef74c7a-d8b9-4f0e-8d6a-5cf3be0d3394 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=c6893b02-9e5e-4658-acac-8bef895b0956 HTTP/1.1" status: 200  len: 848 time: 0.0629604
Jun 01 06:14:50.765743 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['7d7451f5-3439-4d43-8bf7-ac121c8931c4'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:14:50.800044 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-1499895f-25ce-430a-bffd-e84a58af6ad7 req-d7ffa0be-4c9a-42df-a934-9183bacea4a4 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=a6c6ac39-c2dd-414b-b2c1-db0b208abb9a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0455146
Jun 01 06:14:50.813722 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d09b87e1-90c9-4401-83d4-24b7b7e866f9 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:50.824244 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d09b87e1-90c9-4401-83d4-24b7b7e866f9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8086245'] for subnet, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:50.912743 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8739dd9-de64-4f24-ba53-f92d16c03f1d req-a1a351c0-a5a2-4814-9d2e-6c59fc52858a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:50.914437 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a8739dd9-de64-4f24-ba53-f92d16c03f1d req-a1a351c0-a5a2-4814-9d2e-6c59fc52858a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.1705923
Jun 01 06:14:50.941857 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-1499895f-25ce-430a-bffd-e84a58af6ad7 req-2e6b9321-e837-4bd2-8359-bd8e6df6b927 service neutron] 10.222.0.48 "GET /v2.0/networks/a6c6ac39-c2dd-414b-b2c1-db0b208abb9a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1311662
Jun 01 06:14:51.034227 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a8739dd9-de64-4f24-ba53-f92d16c03f1d req-5a1f1daf-ee95-4836-a481-edd541ac9c2c tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0745120
Jun 01 06:14:51.145260 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-1499895f-25ce-430a-bffd-e84a58af6ad7 req-806c13b3-eb9e-47b9-8ad1-1a99903e89c8 service neutron] 10.222.0.48 "GET /v2.0/networks/a6c6ac39-c2dd-414b-b2c1-db0b208abb9a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1957304
Jun 01 06:14:51.147312 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d09b87e1-90c9-4401-83d4-24b7b7e866f9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8087120', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099'] for subnet, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:51.152649 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-2b9883dc-5d7e-4b41-b2d7-8bf63556276d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:51.190976 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d09b87e1-90c9-4401-83d4-24b7b7e866f9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=52a5c0c8-e902-4e55-bfa8-495f043331da,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:51.230365 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-d09b87e1-90c9-4401-83d4-24b7b7e866f9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:51.279340 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d09b87e1-90c9-4401-83d4-24b7b7e866f9 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:51.295544 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-d09b87e1-90c9-4401-83d4-24b7b7e866f9 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/52a5c0c8-e902-4e55-bfa8-495f043331da HTTP/1.1" status: 204  len: 168 time: 0.6617677
Jun 01 06:14:51.298336 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 35960) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:14:51.356037 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63b219f8-da87-44ad-9d8c-1e8de3093034 req-0d8341ef-8ed8-431c-8db2-5c54bdc519d7 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:51.357544 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-63b219f8-da87-44ad-9d8c-1e8de3093034 req-0d8341ef-8ed8-431c-8db2-5c54bdc519d7 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.1643100
Jun 01 06:14:51.365128 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fc6ba25-af0b-4223-bba5-9bd5946fc311 req-48b56501-637b-4bca-8265-9500cd06a90f tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:51.366614 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3fc6ba25-af0b-4223-bba5-9bd5946fc311 req-48b56501-637b-4bca-8265-9500cd06a90f tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1291854
Jun 01 06:14:51.419823 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-5f65cd81-26c4-4eea-8daf-f2af415af49f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8063377'] for network, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:51.436972 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-63b219f8-da87-44ad-9d8c-1e8de3093034 req-62d032dc-d51f-4568-b3de-7e4cebcd705b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0693221
Jun 01 06:14:51.445003 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3fc6ba25-af0b-4223-bba5-9bd5946fc311 req-0ab3f8c1-9148-45db-8d53-b7db6f6c3ceb tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0621989
Jun 01 06:14:51.563034 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-5f65cd81-26c4-4eea-8daf-f2af415af49f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8093290', 'neutron.services.segments.db._delete_segments_for_network-8788497006300'] for network, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:51.577101 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-5f65cd81-26c4-4eea-8daf-f2af415af49f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe3b24f9e20>,) {'filters': {'network_id': ['8c37e9ed-7031-4d7f-bfd1-3763eabba1b6']}} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:14:51.591217 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-5f65cd81-26c4-4eea-8daf-f2af415af49f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b24f9e20>, '7e12089c-d8cc-429c-8b7b-f5d148a55957') {'for_net_delete': True} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:14:51.591217 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-5f65cd81-26c4-4eea-8daf-f2af415af49f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b24f9e20>, '7e12089c-d8cc-429c-8b7b-f5d148a55957') {} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:14:51.603491 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-5f65cd81-26c4-4eea-8daf-f2af415af49f admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8788497014941', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2178892'] for segment, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:51.621090 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-5f65cd81-26c4-4eea-8daf-f2af415af49f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:51.628615 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5f65cd81-26c4-4eea-8daf-f2af415af49f admin admin] Releasing vlan 206 on physical network physnet1 to pool {{(pid=92230) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 06:14:51.629143 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-5f65cd81-26c4-4eea-8daf-f2af415af49f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2416152'] for segment, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]: Traceback (most recent call last):
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:     timer()
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:     cb(*args, **kw)
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:     return func(*args, **kwargs)
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:     self._notify()
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:     self.callback(batched_events)
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:     event.method(event)
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:     return f(self, *a, **k)
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self._get(url).json()
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self.request(url, 'GET', **kwargs)
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 06:14:51.645522 dv-cinder-793885-1-iscsi neutron-server[92230]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 06:14:51.714359 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77ab42bc-3995-472a-8ab1-8ac8e8c69cce req-3c37dfe5-b0e2-4b74-b7ea-93ada72417d2 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:51.715924 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-77ab42bc-3995-472a-8ab1-8ac8e8c69cce req-3c37dfe5-b0e2-4b74-b7ea-93ada72417d2 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 943 time: 0.1016295
Jun 01 06:14:51.735807 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-5f65cd81-26c4-4eea-8daf-f2af415af49f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8093283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-745674'] for network, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:51.741150 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-5f65cd81-26c4-4eea-8daf-f2af415af49f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:51.745116 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-0192083f-63e7-4f3b-a3a4-c72a084de230 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:51.766189 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-5f65cd81-26c4-4eea-8daf-f2af415af49f admin admin] 10.222.0.25 "DELETE /v2.0/networks/8c37e9ed-7031-4d7f-bfd1-3763eabba1b6 HTTP/1.1" status: 204  len: 168 time: 0.4665256
Jun 01 06:14:51.767112 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f65cd81-26c4-4eea-8daf-f2af415af49f admin admin] Pushing event deleted for resources: {'Network': ['ID=8c37e9ed-7031-4d7f-bfd1-3763eabba1b6,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:51.768195 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-77ab42bc-3995-472a-8ab1-8ac8e8c69cce req-aefb4858-09c2-43b7-87f9-2edaec4cfb2b tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0455182
Jun 01 06:14:51.778132 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-5f65cd81-26c4-4eea-8daf-f2af415af49f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:51.899962 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 35978) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:14:51.954171 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-0a3bed38-870b-4953-97bf-5132d7d15c2f admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=b02068c8f29e4f5e9b3c965d023f7e29&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0526595
Jun 01 06:14:51.956734 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 35982) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:14:51.968685 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4fb2198-bbdd-474d-9efe-1e4d68de4943 req-3ecf5958-9d48-4fe9-99e2-dd4bb814253c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:51.970422 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b4fb2198-bbdd-474d-9efe-1e4d68de4943 req-3ecf5958-9d48-4fe9-99e2-dd4bb814253c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 945 time: 0.0974424
Jun 01 06:14:52.021698 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device b27b14f3-a022-418f-8f09-c351f0659164 details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:14:52.023812 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b4fb2198-bbdd-474d-9efe-1e4d68de4943 req-93239ee3-809f-4c0e-ae4b-b61e3ad3908b tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0454288
Jun 01 06:14:52.029015 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-5d44a281-3bd6-4e85-ab44-2f64d9174c9e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:52.060452 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-5d44a281-3bd6-4e85-ab44-2f64d9174c9e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:52.123262 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 7d7451f5-3439-4d43-8bf7-ac121c8931c4 up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:14:52.132753 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-5d44a281-3bd6-4e85-ab44-2f64d9174c9e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:52.139257 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-f17e76aa-6471-4df4-8077-0762684557cd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:52.154255 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d44a281-3bd6-4e85-ab44-2f64d9174c9e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=160af0eb-1010-4f15-828e-742d9c107c26,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:52.157942 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-5d44a281-3bd6-4e85-ab44-2f64d9174c9e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:52.161342 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-5d44a281-3bd6-4e85-ab44-2f64d9174c9e admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:52.163670 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-5d44a281-3bd6-4e85-ab44-2f64d9174c9e admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/160af0eb-1010-4f15-828e-742d9c107c26 HTTP/1.1" status: 204  len: 168 time: 0.2050748
Jun 01 06:14:52.257891 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port b27b14f3-a022-418f-8f09-c351f0659164, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=b27b14f3-a022-418f-8f09-c351f0659164,segment=NetworkSegment(c333deab-77ad-4250-916e-537423452613),segment_id=c333deab-77ad-4250-916e-537423452613)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:14:52.270770 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning for port 7d7451f5-3439-4d43-8bf7-ac121c8931c4 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:14:52.276798 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': 'b27b14f3-a022-418f-8f09-c351f0659164', 'network_id': 'a6c6ac39-c2dd-414b-b2c1-db0b208abb9a', 'port_id': 'b27b14f3-a022-418f-8f09-c351f0659164', 'mac_address': 'fa:16:3e:7c:6c:80', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 236, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c6893b02-9e5e-4658-acac-8bef895b0956', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:14:52.280163 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port 7d7451f5-3439-4d43-8bf7-ac121c8931c4 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:14:52.280588 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:52.308701 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02f26b75-3e62-41f4-b5bc-ff525ddaf14d req-85781773-4a3d-4078-9316-935488f0591a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:52.310791 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-02f26b75-3e62-41f4-b5bc-ff525ddaf14d req-85781773-4a3d-4078-9316-935488f0591a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.0977631
Jun 01 06:14:52.363130 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-02f26b75-3e62-41f4-b5bc-ff525ddaf14d req-95cc21ae-c00a-4220-b00c-aab07a73cc1e tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0461612
Jun 01 06:14:52.394097 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:52.417274 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b27b14f3-a022-418f-8f09-c351f0659164 {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:14:52.478385 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port b27b14f3-a022-418f-8f09-c351f0659164, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=b27b14f3-a022-418f-8f09-c351f0659164,segment=NetworkSegment(c333deab-77ad-4250-916e-537423452613),segment_id=c333deab-77ad-4250-916e-537423452613)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:14:52.487287 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:52.490886 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:52.552342 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:52.592400 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '09215815-8dd9-46e4-879a-7c3b58e35a54', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7d7451f5-3439-4d43-8bf7-ac121c8931c4'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:14:52.594673 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-243a05ac-eb29-4ab2-a953-a7866514f895" -d '{"events": [{"server_uuid": "09215815-8dd9-46e4-879a-7c3b58e35a54", "name": "network-vif-plugged", "status": "completed", "tag": "7d7451f5-3439-4d43-8bf7-ac121c8931c4"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:14:52.598899 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=b27b14f3-a022-418f-8f09-c351f0659164,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:52.602972 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:52.608112 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 7d7451f5-3439-4d43-8bf7-ac121c8931c4, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=7d7451f5-3439-4d43-8bf7-ac121c8931c4,segment=NetworkSegment(e9a368be-e119-4f56-bdcc-b9d10543e0d8),segment_id=e9a368be-e119-4f56-bdcc-b9d10543e0d8)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:14:52.613386 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:52.615960 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:52.694614 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:14:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-80873c3a-f4c0-4e44-a099-03a760dbc951 x-openstack-request-id: req-80873c3a-f4c0-4e44-a099-03a760dbc951 {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:14:52.694903 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "09215815-8dd9-46e4-879a-7c3b58e35a54", "name": "network-vif-plugged", "status": "completed", "tag": "7d7451f5-3439-4d43-8bf7-ac121c8931c4", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:14:52.695197 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-80873c3a-f4c0-4e44-a099-03a760dbc951 {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:14:52.695647 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '09215815-8dd9-46e4-879a-7c3b58e35a54', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7d7451f5-3439-4d43-8bf7-ac121c8931c4', 'code': 200}
Jun 01 06:14:52.697962 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=7d7451f5-3439-4d43-8bf7-ac121c8931c4,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:52.703542 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:52.730860 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4acbf57a-a87c-4ca3-8316-41169e90c759 req-53fcecf8-c559-4a19-ab6c-582a7c5ec386 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:52.732487 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4acbf57a-a87c-4ca3-8316-41169e90c759 req-53fcecf8-c559-4a19-ab6c-582a7c5ec386 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.1397209
Jun 01 06:14:52.778921 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4acbf57a-a87c-4ca3-8316-41169e90c759 req-a4ea3da7-f93d-4c08-a06e-493c59e735e4 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0406778
Jun 01 06:14:52.846986 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['b27b14f3-a022-418f-8f09-c351f0659164'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:14:53.076843 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ece2782c-7a1d-4498-90fd-3afe396142e2 req-487f40ae-9f36-4b2b-8c1e-7b31e912a376 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:53.078776 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ece2782c-7a1d-4498-90fd-3afe396142e2 req-487f40ae-9f36-4b2b-8c1e-7b31e912a376 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 944 time: 0.1521695
Jun 01 06:14:53.134798 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89b91757-5ab3-45df-833b-42b252ca4f5d req-dc014dbe-5499-421e-994a-862eb6b26d14 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:53.136714 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ece2782c-7a1d-4498-90fd-3afe396142e2 req-c1ef0e38-54f8-4a11-812c-e6cf67881358 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0517714
Jun 01 06:14:53.137850 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-89b91757-5ab3-45df-833b-42b252ca4f5d req-dc014dbe-5499-421e-994a-862eb6b26d14 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 1099 time: 0.1441934
Jun 01 06:14:53.197472 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-89b91757-5ab3-45df-833b-42b252ca4f5d req-176e90ea-3af3-49ca-9a1d-0d435c775fcf service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0495915
Jun 01 06:14:53.264712 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5078516-3359-482a-9b14-1e6e41426cc1 req-26f41072-17a7-434b-beda-39e5cbd487ff tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:53.266994 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b5078516-3359-482a-9b14-1e6e41426cc1 req-26f41072-17a7-434b-beda-39e5cbd487ff tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 946 time: 0.0891280
Jun 01 06:14:53.317790 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b5078516-3359-482a-9b14-1e6e41426cc1 req-294bd672-1635-433c-ac38-2cf37c2ccd09 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0448215
Jun 01 06:14:53.645391 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff3adc36-c0c4-4ede-aba5-89709d3824ca req-920189b3-2ad1-40cd-8b91-70cc6932d4f5 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:53.647131 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ff3adc36-c0c4-4ede-aba5-89709d3824ca req-920189b3-2ad1-40cd-8b91-70cc6932d4f5 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.1724260
Jun 01 06:14:53.697107 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ff3adc36-c0c4-4ede-aba5-89709d3824ca req-d881ad42-7e68-4f63-802b-48eb149bab55 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0421796
Jun 01 06:14:53.976184 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8c64c2f-c304-407e-b090-e95307544bbd req-832627d2-09ad-4b86-b935-f883fec4c58d tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:53.977685 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e8c64c2f-c304-407e-b090-e95307544bbd req-832627d2-09ad-4b86-b935-f883fec4c58d tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.0846121
Jun 01 06:14:54.028329 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e8c64c2f-c304-407e-b090-e95307544bbd req-814ccd54-35fe-447a-8e84-b021736b188f tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0448582
Jun 01 06:14:54.063657 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device b27b14f3-a022-418f-8f09-c351f0659164 up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:14:54.142144 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning for port b27b14f3-a022-418f-8f09-c351f0659164 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:14:54.147615 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port b27b14f3-a022-418f-8f09-c351f0659164 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:14:54.148013 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:54.281204 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:54.324014 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port b27b14f3-a022-418f-8f09-c351f0659164, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=b27b14f3-a022-418f-8f09-c351f0659164,segment=NetworkSegment(c333deab-77ad-4250-916e-537423452613),segment_id=c333deab-77ad-4250-916e-537423452613)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:14:54.337306 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:54.341258 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:54.359022 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5832c62a-1304-4707-9c76-13af5adc735f req-28485b9b-82b9-40bc-9b82-50dfc6abedd1 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:54.361153 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5832c62a-1304-4707-9c76-13af5adc735f req-28485b9b-82b9-40bc-9b82-50dfc6abedd1 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 944 time: 0.0931623
Jun 01 06:14:54.425489 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5832c62a-1304-4707-9c76-13af5adc735f req-787b157f-db7b-4176-a71a-d2c84e0f6ec7 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0574000
Jun 01 06:14:54.428967 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=b27b14f3-a022-418f-8f09-c351f0659164,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:54.441846 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:54.456447 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 36064) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:14:54.544377 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77a43844-750a-4367-8cd1-bd04d472c913 req-6f2a36ce-230b-4ee8-a9d2-c46c8ff0914a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:54.545160 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-77a43844-750a-4367-8cd1-bd04d472c913 req-6f2a36ce-230b-4ee8-a9d2-c46c8ff0914a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 946 time: 0.0925205
Jun 01 06:14:54.592209 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-105ad34a-927e-4ec7-9316-6363246dc306 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:54.597076 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-77a43844-750a-4367-8cd1-bd04d472c913 req-55d3edd4-69c8-4ed3-ac6e-14294fdce011 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0457313
Jun 01 06:14:54.616314 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-105ad34a-927e-4ec7-9316-6363246dc306 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:14:54.621904 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-105ad34a-927e-4ec7-9316-6363246dc306 admin admin] Usage tracker for resource:security_group_rule and tenant:e9300a7ce0104f3fa7db09843b28b9aa is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:14:54.625694 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-105ad34a-927e-4ec7-9316-6363246dc306 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:14:54.632015 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-105ad34a-927e-4ec7-9316-6363246dc306 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:14:54.700390 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4a1dafce-1362-4f77-b3ee-1ea2dcc65db3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b27b14f3-a022-418f-8f09-c351f0659164'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:14:54.703173 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-01e70eb0-61cf-4330-9c4c-d43f59e5e361" -d '{"events": [{"server_uuid": "4a1dafce-1362-4f77-b3ee-1ea2dcc65db3", "name": "network-vif-plugged", "status": "completed", "tag": "b27b14f3-a022-418f-8f09-c351f0659164"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:14:54.735146 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-105ad34a-927e-4ec7-9316-6363246dc306 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:54.740135 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-105ad34a-927e-4ec7-9316-6363246dc306 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:54.751097 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:54.751677 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:14:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bdf5f5bc-4abd-49f6-9087-e693c87f879b x-openstack-request-id: req-bdf5f5bc-4abd-49f6-9087-e693c87f879b {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:14:54.752173 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4a1dafce-1362-4f77-b3ee-1ea2dcc65db3", "name": "network-vif-plugged", "status": "completed", "tag": "b27b14f3-a022-418f-8f09-c351f0659164", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:14:54.752635 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-bdf5f5bc-4abd-49f6-9087-e693c87f879b {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:14:54.753231 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4a1dafce-1362-4f77-b3ee-1ea2dcc65db3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b27b14f3-a022-418f-8f09-c351f0659164', 'code': 200}
Jun 01 06:14:54.805467 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-105ad34a-927e-4ec7-9316-6363246dc306 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=e9300a7ce0104f3fa7db09843b28b9aa&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3473670
Jun 01 06:14:54.806455 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-105ad34a-927e-4ec7-9316-6363246dc306 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2176e59e-0fd3-4c3a-8e00-ef5ece9c6494,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:54.809683 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 36082) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:14:54.821976 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-105ad34a-927e-4ec7-9316-6363246dc306 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:54.824408 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52840daa-332d-4888-add4-0255b3833bb6 req-73883e07-082d-4e58-9fae-3238b39bd7d1 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:54.828550 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-52840daa-332d-4888-add4-0255b3833bb6 req-73883e07-082d-4e58-9fae-3238b39bd7d1 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 946 time: 0.1009023
Jun 01 06:14:54.975965 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-52840daa-332d-4888-add4-0255b3833bb6 req-f11f38c7-9057-467a-aa28-c190c6ca8d31 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1360564
Jun 01 06:14:55.000522 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 36086) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:14:55.002967 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-aa152b6b-2491-4881-aace-9268044ec131 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:55.013967 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87ffafa1-cf02-438b-8128-51db7dc1793b req-74634d95-e279-4360-bf67-dcb3d0d1a52d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:55.016008 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-87ffafa1-cf02-438b-8128-51db7dc1793b req-74634d95-e279-4360-bf67-dcb3d0d1a52d service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 1098 time: 0.0902615
Jun 01 06:14:55.039414 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-982059b1-ee3e-45d7-b3bb-16513349f2a8 req-52babc8a-d297-4185-a062-c1f1c6bb93b7 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:55.040945 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-982059b1-ee3e-45d7-b3bb-16513349f2a8 req-52babc8a-d297-4185-a062-c1f1c6bb93b7 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.1724451
Jun 01 06:14:55.046493 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-aa152b6b-2491-4881-aace-9268044ec131 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:55.070797 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-87ffafa1-cf02-438b-8128-51db7dc1793b req-eabe66b9-4ae9-424e-b89c-f01c83c91b3a service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0435977
Jun 01 06:14:55.129106 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-982059b1-ee3e-45d7-b3bb-16513349f2a8 req-dcacea19-314c-4139-9f22-47a6abc5c0bc tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0757022
Jun 01 06:14:55.150578 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-aa152b6b-2491-4881-aace-9268044ec131 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:55.155916 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-3387cbbf-c502-4edb-aa01-d2be387d1033 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:55.168729 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa152b6b-2491-4881-aace-9268044ec131 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2176e59e-0fd3-4c3a-8e00-ef5ece9c6494,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:55.173894 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-aa152b6b-2491-4881-aace-9268044ec131 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:55.217733 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-aa152b6b-2491-4881-aace-9268044ec131 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:55.218838 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-aa152b6b-2491-4881-aace-9268044ec131 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/2176e59e-0fd3-4c3a-8e00-ef5ece9c6494 HTTP/1.1" status: 204  len: 168 time: 0.4045877
Jun 01 06:14:55.262557 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c042f6a-46fd-4329-aef2-1ba4ce210bcd req-97d490b7-e0fa-4f27-9296-ea710ad6c8d7 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:55.264315 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9c042f6a-46fd-4329-aef2-1ba4ce210bcd req-97d490b7-e0fa-4f27-9296-ea710ad6c8d7 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 943 time: 0.0933146
Jun 01 06:14:55.302492 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-368ea451-70c8-42ef-b2c4-9b48a5ad8db8 tempest-TestVolumeBootPattern-1044736619 tempest-TestVolumeBootPattern-1044736619-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:55.303496 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-368ea451-70c8-42ef-b2c4-9b48a5ad8db8 tempest-TestVolumeBootPattern-1044736619 tempest-TestVolumeBootPattern-1044736619-project-admin] Synchronizing usage tracker for tenant:59b1a5cf77d140469fb6596ad2fdef03 on resource:port {{(pid=92230) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:14:55.311222 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9c042f6a-46fd-4329-aef2-1ba4ce210bcd req-e07c8723-0068-4c3f-be6d-1cbc0ca61057 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0415282
Jun 01 06:14:55.323260 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-368ea451-70c8-42ef-b2c4-9b48a5ad8db8 tempest-TestVolumeBootPattern-1044736619 tempest-TestVolumeBootPattern-1044736619-project-admin] Unset dirty status for tenant:59b1a5cf77d140469fb6596ad2fdef03 on resource:port {{(pid=92230) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:14:55.327732 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 36096) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:14:55.327881 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-368ea451-70c8-42ef-b2c4-9b48a5ad8db8 tempest-TestVolumeBootPattern-1044736619 tempest-TestVolumeBootPattern-1044736619-project-admin] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 1094 time: 0.3261161
Jun 01 06:14:55.333088 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Request body: {'floatingip': {'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'port_id': '7d7451f5-3439-4d43-8bf7-ac121c8931c4', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'fixed_ip_address': '172.20.0.12'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:14:55.339110 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:14:55.343051 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Usage tracker for resource:floatingip and tenant:e8bcff3fed924886a68a8562a9f4f8f3 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:14:55.345951 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:14:55.352787 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:14:55.363103 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for floatingip, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:55.508409 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:55.546864 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 36104) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:14:55.565671 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-20a598b4-6b8c-4700-8690-ad968e147abd admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:55.581453 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-20a598b4-6b8c-4700-8690-ad968e147abd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:14:55.585430 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-20a598b4-6b8c-4700-8690-ad968e147abd admin admin] Usage tracker for resource:security_group_rule and tenant:b7b46ca9dda743d0a38a75a1a651fca9 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:14:55.588538 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-20a598b4-6b8c-4700-8690-ad968e147abd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:14:55.594354 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-20a598b4-6b8c-4700-8690-ad968e147abd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:14:55.681698 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-20a598b4-6b8c-4700-8690-ad968e147abd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:55.686921 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-20a598b4-6b8c-4700-8690-ad968e147abd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:55.695842 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e3176a36-8eaa-4541-9ecb-6dd962a23403 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:55.718141 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ed93b2e-cf00-4afb-85a6-b2f23117eeb2 req-6cc78a92-c1ee-4688-988e-2d36bb28cfb6 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:55.719632 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1ed93b2e-cf00-4afb-85a6-b2f23117eeb2 req-6cc78a92-c1ee-4688-988e-2d36bb28cfb6 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 945 time: 0.1668441
Jun 01 06:14:55.735921 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Allocated IP 172.27.2.191 (83b812fb-2cfc-46e4-baa4-745218ea3ed2/a59d7d11-a92c-4b4f-83cf-2095ecee2b51/37de0740-52ba-482e-9948-f00d6e45d2a3) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:14:55.741926 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-20a598b4-6b8c-4700-8690-ad968e147abd admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=b7b46ca9dda743d0a38a75a1a651fca9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1939356
Jun 01 06:14:55.742839 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20a598b4-6b8c-4700-8690-ad968e147abd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8afc34ec-3872-4854-9a83-0f5102740c65,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:55.745856 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 36110) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:14:55.748251 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-20a598b4-6b8c-4700-8690-ad968e147abd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:55.812108 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-dd730d8d-70c6-4461-899e-e2491b29882c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:55.838382 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-dd730d8d-70c6-4461-899e-e2491b29882c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:55.850547 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1ed93b2e-cf00-4afb-85a6-b2f23117eeb2 req-37bf6216-eea7-4da2-9b77-2a355c54392e tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1165714
Jun 01 06:14:55.900812 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-dd730d8d-70c6-4461-899e-e2491b29882c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:55.906984 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-20a598b4-6b8c-4700-8690-ad968e147abd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:55.928890 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd730d8d-70c6-4461-899e-e2491b29882c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8afc34ec-3872-4854-9a83-0f5102740c65,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:55.935528 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-dd730d8d-70c6-4461-899e-e2491b29882c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:55.939273 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:55.940421 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-dd730d8d-70c6-4461-899e-e2491b29882c admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:55.942303 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-dd730d8d-70c6-4461-899e-e2491b29882c admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/8afc34ec-3872-4854-9a83-0f5102740c65 HTTP/1.1" status: 204  len: 168 time: 0.1951318
Jun 01 06:14:55.974078 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:55.978375 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ce554e3c-28b0-4dd7-b4a3-1e41fd5f3855 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:56.052078 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:14:56.054971 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:14:56.059907 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:14:56.078296 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 826848c6-a93a-4712-82dd-39e403bcb79e details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:14:56.191254 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Pushing event updated for resources: {'Port': ['ID=37de0740-52ba-482e-9948-f00d6e45d2a3,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:56.198172 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.219s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:56.274365 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 826848c6-a93a-4712-82dd-39e403bcb79e, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=826848c6-a93a-4712-82dd-39e403bcb79e,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:14:56.289453 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': '826848c6-a93a-4712-82dd-39e403bcb79e', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'port_id': '826848c6-a93a-4712-82dd-39e403bcb79e', 'mac_address': 'fa:16:3e:c4:14:7a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 245, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:14:56.352272 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:56.371334 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 826848c6-a93a-4712-82dd-39e403bcb79e {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:14:56.389241 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 826848c6-a93a-4712-82dd-39e403bcb79e, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=826848c6-a93a-4712-82dd-39e403bcb79e,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:14:56.395074 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:56.400031 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-8b8214dc-92b4-4856-a39e-d61da4083fe8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:56.470143 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=826848c6-a93a-4712-82dd-39e403bcb79e,revision_number=9']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:56.473196 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:56.506961 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8bc40f3-208a-42e5-9078-6359d2b8b821 req-93c7d518-1750-42f2-92dd-4f7de9742f32 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:56.508427 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b8bc40f3-208a-42e5-9078-6359d2b8b821 req-93c7d518-1750-42f2-92dd-4f7de9742f32 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.3993201
Jun 01 06:14:56.663133 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b8bc40f3-208a-42e5-9078-6359d2b8b821 req-054253d3-dcc9-40eb-96a6-bf3cfb2640e6 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1430261
Jun 01 06:14:56.699989 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b4e9992-109e-4fb5-b373-1ce55be4683d req-2c5778ed-f6c4-4f6c-b664-6d223062f68b tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:56.701466 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2b4e9992-109e-4fb5-b373-1ce55be4683d req-2c5778ed-f6c4-4f6c-b664-6d223062f68b tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.4245739
Jun 01 06:14:56.714864 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['826848c6-a93a-4712-82dd-39e403bcb79e'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:14:56.980226 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2b4e9992-109e-4fb5-b373-1ce55be4683d req-1d30ac46-5a9b-484f-8a65-f3f7fbb07233 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1410391
Jun 01 06:14:57.020788 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f12cc8c8-1dd1-45e1-b535-daa8c663c2df req-2c230970-9c19-45db-b446-7b1e72c9c4c8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:57.022263 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f12cc8c8-1dd1-45e1-b535-daa8c663c2df req-2c230970-9c19-45db-b446-7b1e72c9c4c8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 944 time: 0.1854756
Jun 01 06:14:57.034093 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:57.218843 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f12cc8c8-1dd1-45e1-b535-daa8c663c2df req-cd925b95-3e7a-4fcd-963a-48dafdb91d9f tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1881182
Jun 01 06:14:57.255275 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:57.321325 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd1ddac5-56f0-46ca-bb3a-944cc2fe79b8 req-8600c608-a9d2-491f-8148-558d2d4d5933 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:57.324097 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cd1ddac5-56f0-46ca-bb3a-944cc2fe79b8 req-8600c608-a9d2-491f-8148-558d2d4d5933 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 945 time: 0.2318778
Jun 01 06:14:57.442410 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cd1ddac5-56f0-46ca-bb3a-944cc2fe79b8 req-51ad12b4-3838-4f8e-a785-04b6e332bb30 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1117015
Jun 01 06:14:57.521343 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:57.526447 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:57.531530 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ea5b64e8-342c-4f12-8dce-efc32795d7a6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:57.592045 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-745720'] for floatingip, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:57.685336 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Pushing event updated for resources: {'Port': ['ID=37de0740-52ba-482e-9948-f00d6e45d2a3,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:57.689940 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:57.790735 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.db.l3_db [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Floating IP 4c6a9e9d-ea2e-4346-a164-98d7263ff8aa associated. External IP: 172.27.2.191, port: 7d7451f5-3439-4d43-8bf7-ac121c8931c4.
Jun 01 06:14:58.082887 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 36178) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:14:58.096758 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 826848c6-a93a-4712-82dd-39e403bcb79e up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:14:58.167403 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port 826848c6-a93a-4712-82dd-39e403bcb79e triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:14:58.168104 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:58.243407 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-af2f75cf-ab2a-4115-98a7-298e8c93047d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:58.259441 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-af2f75cf-ab2a-4115-98a7-298e8c93047d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:14:58.264535 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-af2f75cf-ab2a-4115-98a7-298e8c93047d admin admin] Usage tracker for resource:security_group_rule and tenant:57a2123d7acb4ad18a3f19fd0173c95a is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:14:58.267553 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-af2f75cf-ab2a-4115-98a7-298e8c93047d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:14:58.273865 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-af2f75cf-ab2a-4115-98a7-298e8c93047d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:14:58.286901 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d79dbf90-08ff-4e18-a334-8e1c27237841 req-94b0258b-4c72-4242-b5c2-cad9f62b1f40 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:58.288397 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d79dbf90-08ff-4e18-a334-8e1c27237841 req-94b0258b-4c72-4242-b5c2-cad9f62b1f40 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.4456444
Jun 01 06:14:58.312969 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:58.345149 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1385f5c8-2a7a-45b1-a982-6f897700aa17', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '826848c6-a93a-4712-82dd-39e403bcb79e'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:14:58.347491 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5a9eb149-b258-45ba-927e-ba1480dfb7be" -d '{"events": [{"server_uuid": "1385f5c8-2a7a-45b1-a982-6f897700aa17", "name": "network-vif-plugged", "status": "completed", "tag": "826848c6-a93a-4712-82dd-39e403bcb79e"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:14:58.358548 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 826848c6-a93a-4712-82dd-39e403bcb79e, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=826848c6-a93a-4712-82dd-39e403bcb79e,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:14:58.362927 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:58.365058 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:58.367374 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-af2f75cf-ab2a-4115-98a7-298e8c93047d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:58.371936 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-af2f75cf-ab2a-4115-98a7-298e8c93047d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:58.382674 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-6f8d7678-a49a-4bd8-b5e6-e7e29d0b01a1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:58.439514 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af2f75cf-ab2a-4115-98a7-298e8c93047d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d53ec2ca-7652-4f1a-b9ed-b6d3afcc2c3b,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:58.445407 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-af2f75cf-ab2a-4115-98a7-298e8c93047d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:58.447312 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d79dbf90-08ff-4e18-a334-8e1c27237841 req-33c2ef6c-549d-4d79-9a52-02553a4ce2c0 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1431217
Jun 01 06:14:58.454751 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-af2f75cf-ab2a-4115-98a7-298e8c93047d admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=57a2123d7acb4ad18a3f19fd0173c95a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3707683
Jun 01 06:14:58.458085 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 36192) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:14:58.467569 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=826848c6-a93a-4712-82dd-39e403bcb79e,revision_number=10']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:58.477757 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50a2ad32-33eb-421d-bf64-d70a02ecb606 req-72a6d475-cd19-4433-8114-057a5b4782ac tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:58.478398 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:58.479735 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-50a2ad32-33eb-421d-bf64-d70a02ecb606 req-72a6d475-cd19-4433-8114-057a5b4782ac tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.3900223
Jun 01 06:14:58.491777 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Router 00ab7a71-e7f7-4524-99c9-7562f23905d1 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92229) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:14:58.534791 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4d4e9c8a-1139-4d7a-aca8-b65bdc06a216 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:58.562559 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4d4e9c8a-1139-4d7a-aca8-b65bdc06a216 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:58.606319 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-50a2ad32-33eb-421d-bf64-d70a02ecb606 req-81e78d46-5acc-454b-a6dc-fd1d4599478b tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1201854
Jun 01 06:14:58.617220 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4d4e9c8a-1139-4d7a-aca8-b65bdc06a216 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:58.660076 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-d90baf75-b8ac-4fee-b73b-33cb7691faf7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:58.690611 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d4e9c8a-1139-4d7a-aca8-b65bdc06a216 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d53ec2ca-7652-4f1a-b9ed-b6d3afcc2c3b,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:58.693643 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-4d4e9c8a-1139-4d7a-aca8-b65bdc06a216 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:58.695800 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4d4e9c8a-1139-4d7a-aca8-b65bdc06a216 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:58.697104 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-4d4e9c8a-1139-4d7a-aca8-b65bdc06a216 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/d53ec2ca-7652-4f1a-b9ed-b6d3afcc2c3b HTTP/1.1" status: 204  len: 168 time: 0.2382083
Jun 01 06:14:58.765649 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-736c583d-7a06-4160-97bf-8326f7ce6a26 req-9eee016b-6142-4e0d-869c-5b4c0f975489 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:58.766921 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-736c583d-7a06-4160-97bf-8326f7ce6a26 req-9eee016b-6142-4e0d-869c-5b4c0f975489 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Synchronizing usage tracker for tenant:8f1cf739e243401eb5da7ee705e856de on resource:port {{(pid=92230) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:14:58.785865 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [req-736c583d-7a06-4160-97bf-8326f7ce6a26 req-9eee016b-6142-4e0d-869c-5b4c0f975489 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Unset dirty status for tenant:8f1cf739e243401eb5da7ee705e856de on resource:port {{(pid=92230) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:14:58.786905 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92229) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:14:58.787047 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-736c583d-7a06-4160-97bf-8326f7ce6a26 req-9eee016b-6142-4e0d-869c-5b4c0f975489 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.48 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 945 time: 0.1606069
Jun 01 06:14:58.796364 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f2d5c71-861c-4584-b5f2-dd549acfdd2c req-160e6af2-7d20-47da-9619-09173be9d3c0 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:58.797919 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5f2d5c71-861c-4584-b5f2-dd549acfdd2c req-160e6af2-7d20-47da-9619-09173be9d3c0 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 946 time: 0.2093403
Jun 01 06:14:58.801339 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2b20820-bd4a-4c3f-b222-5b16cd1b5780 None None] Sync routers for ids ['00ab7a71-e7f7-4524-99c9-7562f23905d1'] in dv-cinder-793885-1-iscsi {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:14:58.817394 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2b20820-bd4a-4c3f-b222-5b16cd1b5780 None None] Routers {'00ab7a71-e7f7-4524-99c9-7562f23905d1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:14:58.818338 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-d2b20820-bd4a-4c3f-b222-5b16cd1b5780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b28fce80>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:14:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['00ab7a71-e7f7-4524-99c9-7562f23905d1'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:14:58.836207 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for floatingip, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:58.899234 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 3.5703449
Jun 01 06:14:58.902060 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '09215815-8dd9-46e4-879a-7c3b58e35a54', 'tag': '7d7451f5-3439-4d43-8bf7-ac121c8931c4'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:14:58.904288 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8b5208ca-2c06-465c-beca-9b041ffde4c1" -d '{"events": [{"name": "network-changed", "server_uuid": "09215815-8dd9-46e4-879a-7c3b58e35a54", "tag": "7d7451f5-3439-4d43-8bf7-ac121c8931c4"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:14:58.954080 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5f2d5c71-861c-4584-b5f2-dd549acfdd2c req-f4291d9a-3fbf-49a2-bd9c-56e90112e77a tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1341667
Jun 01 06:14:58.984276 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:14:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6f3e798d-bdc2-4a37-acf5-76e620aa1f59 x-openstack-request-id: req-6f3e798d-bdc2-4a37-acf5-76e620aa1f59 {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:14:58.984573 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1385f5c8-2a7a-45b1-a982-6f897700aa17", "name": "network-vif-plugged", "status": "completed", "tag": "826848c6-a93a-4712-82dd-39e403bcb79e", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:14:58.984838 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-6f3e798d-bdc2-4a37-acf5-76e620aa1f59 {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:14:58.985281 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1385f5c8-2a7a-45b1-a982-6f897700aa17', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '826848c6-a93a-4712-82dd-39e403bcb79e', 'code': 200}
Jun 01 06:14:58.990050 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [req-736c583d-7a06-4160-97bf-8326f7ce6a26 req-41620860-1770-46ad-bdcd-4001ede98813 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Deleting port 6596ca76-68f1-4ba1-ad74-a27f199ef442 {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:14:58.990598 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-736c583d-7a06-4160-97bf-8326f7ce6a26 req-41620860-1770-46ad-bdcd-4001ede98813 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:59.042233 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:14:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8cc05c79-7400-4834-89f2-60d6a1bb113c x-openstack-request-id: req-8cc05c79-7400-4834-89f2-60d6a1bb113c {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:14:59.042647 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "09215815-8dd9-46e4-879a-7c3b58e35a54", "tag": "7d7451f5-3439-4d43-8bf7-ac121c8931c4", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:14:59.043027 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-8cc05c79-7400-4834-89f2-60d6a1bb113c {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:14:59.043546 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '09215815-8dd9-46e4-879a-7c3b58e35a54', 'tag': '7d7451f5-3439-4d43-8bf7-ac121c8931c4', 'status': 'completed', 'code': 200}
Jun 01 06:14:59.139193 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-d2b20820-bd4a-4c3f-b222-5b16cd1b5780 None None] Set router 00ab7a71-e7f7-4524-99c9-7562f23905d1 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:14:59.197232 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [req-736c583d-7a06-4160-97bf-8326f7ce6a26 req-41620860-1770-46ad-bdcd-4001ede98813 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] For port 6596ca76-68f1-4ba1-ad74-a27f199ef442, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=6596ca76-68f1-4ba1-ad74-a27f199ef442,segment=NetworkSegment(1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e),segment_id=1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e)] {{(pid=92230) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:14:59.198377 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-736c583d-7a06-4160-97bf-8326f7ce6a26 req-41620860-1770-46ad-bdcd-4001ede98813 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:59.234351 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b5208ca-2c06-465c-beca-9b041ffde4c1 req-b8a9a2d8-a0db-4efc-8420-34f5ffa6ef97 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:59.235885 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8b5208ca-2c06-465c-beca-9b041ffde4c1 req-b8a9a2d8-a0db-4efc-8420-34f5ffa6ef97 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=e8bcff3fed924886a68a8562a9f4f8f3&device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 1099 time: 0.1597691
Jun 01 06:14:59.237151 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 36206) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:14:59.279592 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d394ac0b-7a2a-4d64-ace9-7b2d51a6e876 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:59.330474 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [req-736c583d-7a06-4160-97bf-8326f7ce6a26 req-41620860-1770-46ad-bdcd-4001ede98813 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Calling delete_port for 6596ca76-68f1-4ba1-ad74-a27f199ef442 owned by compute:nova {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:14:59.354171 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-855bc4f9-e2f3-4669-bb3c-a59a3d2203f9 req-c86dd390-fbed-4e0e-839c-07b049605478 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:59.355730 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-855bc4f9-e2f3-4669-bb3c-a59a3d2203f9 req-c86dd390-fbed-4e0e-839c-07b049605478 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 945 time: 0.2329860
Jun 01 06:14:59.374055 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-d394ac0b-7a2a-4d64-ace9-7b2d51a6e876 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:14:59.394683 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-d394ac0b-7a2a-4d64-ace9-7b2d51a6e876 admin admin] Usage tracker for resource:security_group_rule and tenant:7e36786d3f45466cafd1a362fe2513fc is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:14:59.400386 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-d394ac0b-7a2a-4d64-ace9-7b2d51a6e876 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:14:59.425097 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-d394ac0b-7a2a-4d64-ace9-7b2d51a6e876 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:14:59.456775 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-736c583d-7a06-4160-97bf-8326f7ce6a26 req-41620860-1770-46ad-bdcd-4001ede98813 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:59.470480 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['5f320f89-ada2-472d-b9ac-0676b4c4b578', '6596ca76-68f1-4ba1-ad74-a27f199ef442'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:14:59.474824 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-855bc4f9-e2f3-4669-bb3c-a59a3d2203f9 req-3e6c9d5b-fdc2-4707-8c04-8b6ce10c072f tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1020048
Jun 01 06:14:59.484727 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-c6098c46-b888-410b-b59c-ff879b293c22 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:14:59.495417 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b5208ca-2c06-465c-beca-9b041ffde4c1 req-b875094d-6a3d-47b2-8716-eab75110e759 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:14:59.503573 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8b5208ca-2c06-465c-beca-9b041ffde4c1 req-b875094d-6a3d-47b2-8716-eab75110e759 service neutron] 10.222.0.48 "GET /v2.0/networks?id=028fef0a-f05a-48d5-ba5c-b539846209ba HTTP/1.1" status: 200  len: 912 time: 0.2506225
Jun 01 06:14:59.655499 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-d2b20820-bd4a-4c3f-b222-5b16cd1b5780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b28fce80>, [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '4c6a9e9d-ea2e-4346-a164-98d7263ff8aa', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'floating_ip_address': '172.27.2.191', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'port_id': '7d7451f5-3439-4d43-8bf7-ac121c8931c4', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 425, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'mac_address': 'fa:16:3e:70:80:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09215815-8dd9-46e4-879a-7c3b58e35a54', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:14:56Z', 'updated_at': '2021-06-01T06:14:56Z', 'revision_number': 0, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cd6dda6e-46d3-4412-9652-c686f5fad712', 'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'mac_address': 'fa:16:3e:aa:f2:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:24Z', 'updated_at': '2021-06-01T06:13:41Z', 'revision_number': 5, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'subnets': [{'id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:14:59.663099 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2b20820-bd4a-4c3f-b222-5b16cd1b5780 None None] Checking router: 00ab7a71-e7f7-4524-99c9-7562f23905d1 for host: dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:14:59.679917 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41620860-1770-46ad-bdcd-4001ede98813 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Pushing event deleted for resources: {'Port': ['ID=6596ca76-68f1-4ba1-ad74-a27f199ef442,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:14:59.681163 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2b20820-bd4a-4c3f-b222-5b16cd1b5780 None None] Routers {'00ab7a71-e7f7-4524-99c9-7562f23905d1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:14:59.682481 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-d2b20820-bd4a-4c3f-b222-5b16cd1b5780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b28fce80>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:14:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['00ab7a71-e7f7-4524-99c9-7562f23905d1'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:14:59.692037 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-41620860-1770-46ad-bdcd-4001ede98813 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:14:59.694149 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [req-736c583d-7a06-4160-97bf-8326f7ce6a26 req-41620860-1770-46ad-bdcd-4001ede98813 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] No DVR routers for this DVR port 6596ca76-68f1-4ba1-ad74-a27f199ef442 on host hv-cinder-79388 {{(pid=92230) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:14:59.696977 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [req-736c583d-7a06-4160-97bf-8326f7ce6a26 req-41620860-1770-46ad-bdcd-4001ede98813 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:14:59.709677 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a', 'name': 'network-vif-deleted', 'tag': '6596ca76-68f1-4ba1-ad74-a27f199ef442'}] {{(pid=92230) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:14:59.713381 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a8971187fdc179bafebfda031591b22633150c3ea1d9449252a7819502f19756" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-71ead595-1a79-4a34-b055-9195f6310307" -d '{"events": [{"server_uuid": "72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a", "name": "network-vif-deleted", "tag": "6596ca76-68f1-4ba1-ad74-a27f199ef442"}]}' {{(pid=92230) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:14:59.719595 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-736c583d-7a06-4160-97bf-8326f7ce6a26 req-41620860-1770-46ad-bdcd-4001ede98813 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.48 "DELETE /v2.0/ports/6596ca76-68f1-4ba1-ad74-a27f199ef442 HTTP/1.1" status: 204  len: 173 time: 0.9220088
Jun 01 06:14:59.764147 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-87e6b232-e701-4754-9323-a6d0ed5b7adc req-550da62c-9ef0-4114-a503-a08ee4a4fd31 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a HTTP/1.1" status: 200  len: 210 time: 0.0751159
Jun 01 06:14:59.798676 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8b5208ca-2c06-465c-beca-9b041ffde4c1 req-e64444f4-5756-4fad-9d7c-868e897df90c service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7d7451f5-3439-4d43-8bf7-ac121c8931c4 HTTP/1.1" status: 200  len: 1000 time: 0.2804270
Jun 01 06:14:59.881650 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:14:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1adcd31d-a7a6-4e7e-9f46-d8263448533e x-openstack-request-id: req-1adcd31d-a7a6-4e7e-9f46-d8263448533e {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:14:59.881650 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a", "name": "network-vif-deleted", "tag": "6596ca76-68f1-4ba1-ad74-a27f199ef442", "status": "completed", "code": 200}]} {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:14:59.881650 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-1adcd31d-a7a6-4e7e-9f46-d8263448533e {{(pid=92230) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:14:59.881650 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '72e23d4b-7ca9-44d1-bd66-bd43c3e35b6a', 'name': 'network-vif-deleted', 'tag': '6596ca76-68f1-4ba1-ad74-a27f199ef442', 'status': 'completed', 'code': 200}
Jun 01 06:14:59.937167 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-d2b20820-bd4a-4c3f-b222-5b16cd1b5780 None None] Set router 00ab7a71-e7f7-4524-99c9-7562f23905d1 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:15:00.033706 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d394ac0b-7a2a-4d64-ace9-7b2d51a6e876 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:00.054684 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d394ac0b-7a2a-4d64-ace9-7b2d51a6e876 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:00.067589 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-a9e7ec46-6ee2-43dc-9501-8723db0170b0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:00.076430 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf767bd3-0403-42cf-b409-4d16733a78d8 req-42e4d247-52ea-4f12-aec6-3e8705900909 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:00.077908 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bf767bd3-0403-42cf-b409-4d16733a78d8 req-42e4d247-52ea-4f12-aec6-3e8705900909 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 1099 time: 0.4718771
Jun 01 06:15:00.159393 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b5208ca-2c06-465c-beca-9b041ffde4c1 req-3057013a-30f0-4e87-804e-c3a80d78aeb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:00.160852 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8b5208ca-2c06-465c-beca-9b041ffde4c1 req-3057013a-30f0-4e87-804e-c3a80d78aeb0 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=cdffe000-7f35-495d-a741-b4c48a060887 HTTP/1.1" status: 200  len: 850 time: 0.3521059
Jun 01 06:15:00.190844 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-d394ac0b-7a2a-4d64-ace9-7b2d51a6e876 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=7e36786d3f45466cafd1a362fe2513fc&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9526882
Jun 01 06:15:00.193687 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 36218) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:00.230883 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d394ac0b-7a2a-4d64-ace9-7b2d51a6e876 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5677c472-0c8d-4224-a56f-a432871fcf12,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:00.234669 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-d394ac0b-7a2a-4d64-ace9-7b2d51a6e876 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:00.277857 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bf767bd3-0403-42cf-b409-4d16733a78d8 req-1f9aa101-0f8c-4cf2-a786-9df33be2eff5 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1756017
Jun 01 06:15:00.278421 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-fedc0ed2-c283-469f-9d3d-83e371756701 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:00.304129 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-871e14d3-4be6-4543-8bc1-baa1bb8be61d req-f04b4c42-7deb-493b-bfe8-14f874147757 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:00.305732 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-871e14d3-4be6-4543-8bc1-baa1bb8be61d req-f04b4c42-7deb-493b-bfe8-14f874147757 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.4558113
Jun 01 06:15:00.314595 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-fedc0ed2-c283-469f-9d3d-83e371756701 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:00.322504 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-d2b20820-bd4a-4c3f-b222-5b16cd1b5780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b28fce80>, [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '4c6a9e9d-ea2e-4346-a164-98d7263ff8aa', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'floating_ip_address': '172.27.2.191', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'port_id': '7d7451f5-3439-4d43-8bf7-ac121c8931c4', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 425, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'mac_address': 'fa:16:3e:70:80:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09215815-8dd9-46e4-879a-7c3b58e35a54', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:14:56Z', 'updated_at': '2021-06-01T06:14:56Z', 'revision_number': 0, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cd6dda6e-46d3-4412-9652-c686f5fad712', 'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'mac_address': 'fa:16:3e:aa:f2:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:24Z', 'updated_at': '2021-06-01T06:13:41Z', 'revision_number': 5, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'subnets': [{'id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:00.326856 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2b20820-bd4a-4c3f-b222-5b16cd1b5780 None None] The sync data for ids ['00ab7a71-e7f7-4524-99c9-7562f23905d1'] in dv-cinder-793885-1-iscsi is: [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '4c6a9e9d-ea2e-4346-a164-98d7263ff8aa', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'floating_ip_address': '172.27.2.191', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'port_id': '7d7451f5-3439-4d43-8bf7-ac121c8931c4', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 425, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'mac_address': 'fa:16:3e:70:80:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09215815-8dd9-46e4-879a-7c3b58e35a54', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:14:56Z', 'updated_at': '2021-06-01T06:14:56Z', 'revision_number': 0, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cd6dda6e-46d3-4412-9652-c686f5fad712', 'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'mac_address': 'fa:16:3e:aa:f2:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:24Z', 'updated_at': '2021-06-01T06:13:41Z', 'revision_number': 5, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'subnets': [{'id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:15:00.355185 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bc4a4c9-d978-4640-b210-c6684bfe0de6 req-716455cc-66bf-43e3-84c7-cb313bc8ed0f tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:00.356779 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9bc4a4c9-d978-4640-b210-c6684bfe0de6 req-716455cc-66bf-43e3-84c7-cb313bc8ed0f tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 946 time: 0.2652214
Jun 01 06:15:00.380020 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-fedc0ed2-c283-469f-9d3d-83e371756701 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:00.386233 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-f72bae27-034c-4d20-b069-d2f9c1a83631 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:00.401537 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fedc0ed2-c283-469f-9d3d-83e371756701 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5677c472-0c8d-4224-a56f-a432871fcf12,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:00.402475 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-871e14d3-4be6-4543-8bc1-baa1bb8be61d req-ea65e30f-94c2-487f-baa7-ffee7c964dda tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0874314
Jun 01 06:15:00.407412 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b5208ca-2c06-465c-beca-9b041ffde4c1 req-9b763781-53db-41b8-92ab-3b5eb801dc4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:00.408947 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8b5208ca-2c06-465c-beca-9b041ffde4c1 req-9b763781-53db-41b8-92ab-3b5eb801dc4f service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=028fef0a-f05a-48d5-ba5c-b539846209ba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2154951
Jun 01 06:15:00.417036 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-fedc0ed2-c283-469f-9d3d-83e371756701 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:00.418129 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-fedc0ed2-c283-469f-9d3d-83e371756701 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:00.420237 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-fedc0ed2-c283-469f-9d3d-83e371756701 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/5677c472-0c8d-4224-a56f-a432871fcf12 HTTP/1.1" status: 204  len: 168 time: 0.2250109
Jun 01 06:15:00.518084 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9bc4a4c9-d978-4640-b210-c6684bfe0de6 req-5b374b4d-1afc-4269-bad5-bc4447efe927 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1391449
Jun 01 06:15:00.607024 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8b5208ca-2c06-465c-beca-9b041ffde4c1 req-c319d4a8-c10a-4bb4-9657-a8557d742c3e service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1789219
Jun 01 06:15:00.693382 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8633cff-5caf-40f2-8a07-10877ed2c1f7 None None] New status for floating IP 4c6a9e9d-ea2e-4346-a164-98d7263ff8aa: ACTIVE {{(pid=92231) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 06:15:00.885171 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8b5208ca-2c06-465c-beca-9b041ffde4c1 req-9c693d56-1991-4818-95b7-41d6367cfaf9 service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2707329
Jun 01 06:15:00.910702 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4593da20-b2eb-46f4-8188-720f1aaba7b3 req-d0a98703-03fa-47d6-9df0-f105d347d8e5 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:00.912433 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4593da20-b2eb-46f4-8188-720f1aaba7b3 req-d0a98703-03fa-47d6-9df0-f105d347d8e5 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 945 time: 0.2154865
Jun 01 06:15:00.922602 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f4d7761-a94e-4165-8560-dab6371f1711 req-1919b06f-185f-4828-a4dc-dca6b558fa20 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:00.924109 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7f4d7761-a94e-4165-8560-dab6371f1711 req-1919b06f-185f-4828-a4dc-dca6b558fa20 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.48 "GET /v2.0/ports?device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 945 time: 0.1836481
Jun 01 06:15:01.022865 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4593da20-b2eb-46f4-8188-720f1aaba7b3 req-8b6ddad6-ac0c-4f80-a5a3-a7658c02d6af tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0976872
Jun 01 06:15:01.126542 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-7f4d7761-a94e-4165-8560-dab6371f1711 req-920b90fa-4aba-4045-b6fb-fe8cfa0199d2 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Deleting port b27b14f3-a022-418f-8f09-c351f0659164 {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:15:01.126887 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-7f4d7761-a94e-4165-8560-dab6371f1711 req-920b90fa-4aba-4045-b6fb-fe8cfa0199d2 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:01.296602 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-7f4d7761-a94e-4165-8560-dab6371f1711 req-920b90fa-4aba-4045-b6fb-fe8cfa0199d2 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] For port b27b14f3-a022-418f-8f09-c351f0659164, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=b27b14f3-a022-418f-8f09-c351f0659164,segment=NetworkSegment(c333deab-77ad-4250-916e-537423452613),segment_id=c333deab-77ad-4250-916e-537423452613)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:15:01.296959 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-7f4d7761-a94e-4165-8560-dab6371f1711 req-920b90fa-4aba-4045-b6fb-fe8cfa0199d2 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:01.476812 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-7f4d7761-a94e-4165-8560-dab6371f1711 req-920b90fa-4aba-4045-b6fb-fe8cfa0199d2 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Calling delete_port for b27b14f3-a022-418f-8f09-c351f0659164 owned by compute:nova {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:15:01.530121 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b987afdb-38a1-4ddf-a49f-dff44da0d557 req-582d512e-90a2-426c-8728-94b1f21fea7e tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:01.531646 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b987afdb-38a1-4ddf-a49f-dff44da0d557 req-582d512e-90a2-426c-8728-94b1f21fea7e tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.2377131
Jun 01 06:15:01.667078 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b987afdb-38a1-4ddf-a49f-dff44da0d557 req-01679429-425c-4ee0-883b-5a1a481ab404 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1173742
Jun 01 06:15:01.746278 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7509b6f9-fb2b-4849-8319-7f534992899a req-a70ca985-d3fa-4cd4-814d-8f0cb3294576 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:01.756439 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7509b6f9-fb2b-4849-8319-7f534992899a req-a70ca985-d3fa-4cd4-814d-8f0cb3294576 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.1800950
Jun 01 06:15:01.773423 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-7f4d7761-a94e-4165-8560-dab6371f1711 req-920b90fa-4aba-4045-b6fb-fe8cfa0199d2 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:01.787413 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:01.795628 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['b27b14f3-a022-418f-8f09-c351f0659164'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:15:01.892070 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-920b90fa-4aba-4045-b6fb-fe8cfa0199d2 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Pushing event deleted for resources: {'Port': ['ID=b27b14f3-a022-418f-8f09-c351f0659164,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:02.040567 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-920b90fa-4aba-4045-b6fb-fe8cfa0199d2 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.253s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:02.099483 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 6596ca76-68f1-4ba1-ad74-a27f199ef442 no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:15:02.103325 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7509b6f9-fb2b-4849-8319-7f534992899a req-56c056b8-250f-4027-838d-d54fce44531d tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.3461788
Jun 01 06:15:02.111722 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-7f4d7761-a94e-4165-8560-dab6371f1711 req-920b90fa-4aba-4045-b6fb-fe8cfa0199d2 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] No DVR routers for this DVR port b27b14f3-a022-418f-8f09-c351f0659164 on host hv-cinder-79388 {{(pid=92229) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:15:02.147905 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] No Port match for: 6596ca76-68f1-4ba1-ad74-a27f199ef442 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:15:02.148517 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 6596ca76-68f1-4ba1-ad74-a27f199ef442 not bound to the agent host hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:15:02.149128 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device b27b14f3-a022-418f-8f09-c351f0659164 no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:15:02.161416 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-7f4d7761-a94e-4165-8560-dab6371f1711 req-920b90fa-4aba-4045-b6fb-fe8cfa0199d2 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:02.165115 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4a1dafce-1362-4f77-b3ee-1ea2dcc65db3', 'name': 'network-vif-deleted', 'tag': 'b27b14f3-a022-418f-8f09-c351f0659164'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:15:02.168131 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-67b513a1-bdb2-4caf-8f80-6267e09ac64a" -d '{"events": [{"server_uuid": "4a1dafce-1362-4f77-b3ee-1ea2dcc65db3", "name": "network-vif-deleted", "tag": "b27b14f3-a022-418f-8f09-c351f0659164"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:15:02.191956 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] No Port match for: b27b14f3-a022-418f-8f09-c351f0659164 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:15:02.192717 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device b27b14f3-a022-418f-8f09-c351f0659164 not bound to the agent host hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:15:02.198761 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7f4d7761-a94e-4165-8560-dab6371f1711 req-920b90fa-4aba-4045-b6fb-fe8cfa0199d2 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.48 "DELETE /v2.0/ports/b27b14f3-a022-418f-8f09-c351f0659164 HTTP/1.1" status: 204  len: 173 time: 1.2567880
Jun 01 06:15:02.225470 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed584bb4-952b-412b-9454-87132a9a03ab req-85ef50db-9dc0-4ef0-ae10-5c31b95a97b7 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:02.226986 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ed584bb4-952b-412b-9454-87132a9a03ab req-85ef50db-9dc0-4ef0-ae10-5c31b95a97b7 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 946 time: 0.3454823
Jun 01 06:15:02.338739 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-f72d21dc-3edc-4289-8537-2b468d49269c req-7984d1cd-dba8-4a89-9f4f-d696792fc5f2 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Synchronizing usage tracker for tenant:dd97906039e7487cbb91b21981aa107c on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:15:02.353014 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ed584bb4-952b-412b-9454-87132a9a03ab req-16eae482-e719-413f-8f1d-ebbf63ba1c6b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1187053
Jun 01 06:15:02.365851 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-f72d21dc-3edc-4289-8537-2b468d49269c req-7984d1cd-dba8-4a89-9f4f-d696792fc5f2 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Unset dirty status for tenant:dd97906039e7487cbb91b21981aa107c on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:15:02.368324 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f72d21dc-3edc-4289-8537-2b468d49269c req-7984d1cd-dba8-4a89-9f4f-d696792fc5f2 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=4a1dafce-1362-4f77-b3ee-1ea2dcc65db3 HTTP/1.1" status: 200  len: 210 time: 0.0982232
Jun 01 06:15:02.435159 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:15:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3835d726-36ad-4cad-8b1b-df41a50a192f x-openstack-request-id: req-3835d726-36ad-4cad-8b1b-df41a50a192f {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:15:02.435439 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4a1dafce-1362-4f77-b3ee-1ea2dcc65db3", "name": "network-vif-deleted", "tag": "b27b14f3-a022-418f-8f09-c351f0659164", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:15:02.435746 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-3835d726-36ad-4cad-8b1b-df41a50a192f {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:15:02.436210 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4a1dafce-1362-4f77-b3ee-1ea2dcc65db3', 'name': 'network-vif-deleted', 'tag': 'b27b14f3-a022-418f-8f09-c351f0659164', 'status': 'completed', 'code': 200}
Jun 01 06:15:02.782744 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-873e3b15-82c9-45df-b0f7-f18db124467a req-1a15fe6e-5d2b-4fb3-8849-3500814fb363 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:02.789663 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-873e3b15-82c9-45df-b0f7-f18db124467a req-1a15fe6e-5d2b-4fb3-8849-3500814fb363 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.1470735
Jun 01 06:15:02.901270 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-873e3b15-82c9-45df-b0f7-f18db124467a req-a2eb5474-dd54-46cb-841f-dc241e64d7fe tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1100471
Jun 01 06:15:02.922338 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf4747ab-be3e-4417-8161-2f86e15e3acc req-0a3bc243-c063-4f3f-9851-3a3d5d047723 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:02.923578 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bf4747ab-be3e-4417-8161-2f86e15e3acc req-0a3bc243-c063-4f3f-9851-3a3d5d047723 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=ac4006667c3442a3910d548e9e9d22c0&device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 1098 time: 0.2065134
Jun 01 06:15:02.939936 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a47ee92-7995-4414-ba7d-1ad40a4ac7e4 req-f12e6acd-b0dd-46fe-b71f-2b7f01a70f43 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:02.941397 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8a47ee92-7995-4414-ba7d-1ad40a4ac7e4 req-f12e6acd-b0dd-46fe-b71f-2b7f01a70f43 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1346312
Jun 01 06:15:03.083897 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8a47ee92-7995-4414-ba7d-1ad40a4ac7e4 req-47304e42-e152-4cba-9421-73b63fc41e71 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1219294
Jun 01 06:15:03.115257 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf4747ab-be3e-4417-8161-2f86e15e3acc req-65f45e60-f394-490f-a862-4f952fee39f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:03.116758 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bf4747ab-be3e-4417-8161-2f86e15e3acc req-65f45e60-f394-490f-a862-4f952fee39f8 service neutron] 10.222.0.48 "GET /v2.0/networks?id=0890ab9c-2266-4ef4-af73-d3ff421b9bd7 HTTP/1.1" status: 200  len: 912 time: 0.1851406
Jun 01 06:15:03.222912 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bf4747ab-be3e-4417-8161-2f86e15e3acc req-8dab1c2f-1b76-42d1-bbc0-f636c7686352 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=42597738-974b-4af6-a799-e37d02b057b9 HTTP/1.1" status: 200  len: 1000 time: 0.0977991
Jun 01 06:15:03.288615 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf4747ab-be3e-4417-8161-2f86e15e3acc req-b60ad974-e5a6-4d6a-8013-a4d7dffa520b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:03.290023 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bf4747ab-be3e-4417-8161-2f86e15e3acc req-b60ad974-e5a6-4d6a-8013-a4d7dffa520b service neutron] 10.222.0.48 "GET /v2.0/subnets?id=3e980239-de35-45a0-8039-8395b5408617 HTTP/1.1" status: 200  len: 850 time: 0.0577049
Jun 01 06:15:03.374913 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf4747ab-be3e-4417-8161-2f86e15e3acc req-97e445b0-60e4-4c06-9265-b5121a3a1d92 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:03.376418 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bf4747ab-be3e-4417-8161-2f86e15e3acc req-97e445b0-60e4-4c06-9265-b5121a3a1d92 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=0890ab9c-2266-4ef4-af73-d3ff421b9bd7&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0754435
Jun 01 06:15:03.577617 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bf4747ab-be3e-4417-8161-2f86e15e3acc req-00364784-b832-4926-9a88-90bf3b169329 service neutron] 10.222.0.48 "GET /v2.0/networks/0890ab9c-2266-4ef4-af73-d3ff421b9bd7?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1940730
Jun 01 06:15:03.668986 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f834ba5-6b36-44bd-8054-815b3e64eb7f req-403fd780-935b-4782-a23b-2c36a1228e48 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:03.670458 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5f834ba5-6b36-44bd-8054-815b3e64eb7f req-403fd780-935b-4782-a23b-2c36a1228e48 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 946 time: 0.1883776
Jun 01 06:15:03.847678 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5f834ba5-6b36-44bd-8054-815b3e64eb7f req-99a38746-3277-4963-ba63-583670c3d97f tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1706414
Jun 01 06:15:03.867115 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bf4747ab-be3e-4417-8161-2f86e15e3acc req-b86bb4c8-f297-4ae2-8a78-98196076a5cf service neutron] 10.222.0.48 "GET /v2.0/networks/0890ab9c-2266-4ef4-af73-d3ff421b9bd7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2816732
Jun 01 06:15:03.901662 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-20e5ed0b-5276-45b2-99f6-70da365a9f0a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:03.903139 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-20e5ed0b-5276-45b2-99f6-70da365a9f0a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/networks?id=a6c6ac39-c2dd-414b-b2c1-db0b208abb9a HTTP/1.1" status: 200  len: 808 time: 0.2278707
Jun 01 06:15:03.918297 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-8c3f4104-36e4-490d-a8bc-e9afcecf9a9c tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/quotas/dd97906039e7487cbb91b21981aa107c HTTP/1.1" status: 200  len: 375 time: 0.0094855
Jun 01 06:15:03.966386 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-9c5f78a7-fee7-4618-8c0b-511b0f6d3f96 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=dd97906039e7487cbb91b21981aa107c&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0426502
Jun 01 06:15:04.275309 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-b053ddc6-18c0-48fa-8b45-e2d15c648d57 service neutron] 10.222.0.25 "GET /v2.0/networks/a6c6ac39-c2dd-414b-b2c1-db0b208abb9a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3020725
Jun 01 06:15:04.365649 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e12acc33-fa31-4064-af08-9d27a7e5c1f3 req-3dd499ed-cdb0-4841-bd3f-dad7c280377b tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:04.367005 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e12acc33-fa31-4064-af08-9d27a7e5c1f3 req-3dd499ed-cdb0-4841-bd3f-dad7c280377b tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.3179049
Jun 01 06:15:04.459928 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e12acc33-fa31-4064-af08-9d27a7e5c1f3 req-7c6f037f-1f26-4a1e-a4e3-dbcc36442da4 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0850313
Jun 01 06:15:04.500175 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-72c711f5-a130-4c02-8089-c48b109bd738 service neutron] 10.222.0.25 "GET /v2.0/networks/a6c6ac39-c2dd-414b-b2c1-db0b208abb9a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2181873
Jun 01 06:15:04.693171 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2b2d2520-3811-42fe-8442-81f6f12f449e req-c01c481c-ef39-41f2-93d8-6c3eee9b1a5d tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=6d41e731-342f-457d-82c5-09f702557793 HTTP/1.1" status: 200  len: 210 time: 0.0510435
Jun 01 06:15:04.721982 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e84dbae-91dd-4ac1-97f3-41832c77d53f req-d14872c3-2bc0-4b1a-8635-99c4d72ef582 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:04.723447 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8e84dbae-91dd-4ac1-97f3-41832c77d53f req-d14872c3-2bc0-4b1a-8635-99c4d72ef582 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1360233
Jun 01 06:15:04.771821 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8e84dbae-91dd-4ac1-97f3-41832c77d53f req-9603b852-5722-4fa0-ac12-90d3bbb4083c tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0423386
Jun 01 06:15:05.647614 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6055cbb5-8bce-49ae-98d9-ea05f8e09323 req-e6156843-540e-4fd9-9782-9522cbc205d1 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:05.649084 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6055cbb5-8bce-49ae-98d9-ea05f8e09323 req-e6156843-540e-4fd9-9782-9522cbc205d1 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.0786219
Jun 01 06:15:05.696316 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6055cbb5-8bce-49ae-98d9-ea05f8e09323 req-fe1c0389-be8a-48ac-ae84-a1071f26bf5c tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0415378
Jun 01 06:15:05.849599 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bef6a495-0562-493a-afa9-c6d064fba9ec req-9f3fe974-3c9c-471f-9cae-5206d577ca61 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=6d41e731-342f-457d-82c5-09f702557793 HTTP/1.1" status: 200  len: 210 time: 0.0515544
Jun 01 06:15:05.962927 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92a62a07-d3b9-4675-8fc3-9f11d396d66f req-9e5d5364-159e-48c3-8b72-ab5c235d1d27 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:05.965002 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-92a62a07-d3b9-4675-8fc3-9f11d396d66f req-9e5d5364-159e-48c3-8b72-ab5c235d1d27 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.0827293
Jun 01 06:15:06.008701 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-92a62a07-d3b9-4675-8fc3-9f11d396d66f req-2eb77179-f48d-4bdb-842e-ba9c0411a765 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0380156
Jun 01 06:15:07.000108 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-89ca8d79-99fd-4399-bd4b-cf7a90c6d424 req-32d9f91d-60cb-490b-9a6b-5e76f9233db3 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=6d41e731-342f-457d-82c5-09f702557793 HTTP/1.1" status: 200  len: 210 time: 0.0447888
Jun 01 06:15:07.190987 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0470864-c58e-485c-b2f8-1c159d56b593 req-c0daf17a-4e69-4a37-b9f1-71df4c98ab05 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:07.192386 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d0470864-c58e-485c-b2f8-1c159d56b593 req-c0daf17a-4e69-4a37-b9f1-71df4c98ab05 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.0794811
Jun 01 06:15:07.237942 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d0470864-c58e-485c-b2f8-1c159d56b593 req-99e74848-d809-49f0-8245-3b3aa98a30fc tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397663
Jun 01 06:15:08.154376 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-aab30db0-4e30-4a75-90e3-a579877b53be req-42931024-52c2-42ec-b55f-83020d7542e0 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=6d41e731-342f-457d-82c5-09f702557793 HTTP/1.1" status: 200  len: 210 time: 0.0449226
Jun 01 06:15:08.336566 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-ffaa2d24-762a-4251-99c8-4abf64a1a623 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:08.569126 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-e604e940-619b-465b-bc18-3bfa590972be tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:08.570569 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-e604e940-619b-465b-bc18-3bfa590972be tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.48 "GET /v2.0/networks?id=a6c6ac39-c2dd-414b-b2c1-db0b208abb9a HTTP/1.1" status: 200  len: 808 time: 0.1867917
Jun 01 06:15:08.579614 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-740ea47b-85ca-4e9c-b7f3-dc2fc4099d87 req-9cdc61cc-dd3f-4d43-afc1-968129b09de9 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:08.581127 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-740ea47b-85ca-4e9c-b7f3-dc2fc4099d87 req-9cdc61cc-dd3f-4d43-afc1-968129b09de9 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.2296162
Jun 01 06:15:08.587675 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-0cb2a14e-7f18-4efe-b3b0-2929f61f5c79 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Request body: {'port': {'device_id': '6d41e731-342f-457d-82c5-09f702557793', 'network_id': 'a6c6ac39-c2dd-414b-b2c1-db0b208abb9a', 'admin_state_up': True, 'tenant_id': 'dd97906039e7487cbb91b21981aa107c'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:15:08.725385 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-740ea47b-85ca-4e9c-b7f3-dc2fc4099d87 req-1952b96a-630f-45cc-b31f-5c84694d29c5 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1184325
Jun 01 06:15:08.774524 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-0cb2a14e-7f18-4efe-b3b0-2929f61f5c79 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:08.786186 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-0cb2a14e-7f18-4efe-b3b0-2929f61f5c79 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:08.800122 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-0cb2a14e-7f18-4efe-b3b0-2929f61f5c79 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Made reservation on behalf of dd97906039e7487cbb91b21981aa107c for: {'port': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:15:08.803598 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-0cb2a14e-7f18-4efe-b3b0-2929f61f5c79 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:08.970114 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-0cb2a14e-7f18-4efe-b3b0-2929f61f5c79 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Allocated IP 172.20.0.12 (a6c6ac39-c2dd-414b-b2c1-db0b208abb9a/c6893b02-9e5e-4658-acac-8bef895b0956/b52209fd-778b-498b-aa98-e818d0fee891) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:15:09.182865 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-0cb2a14e-7f18-4efe-b3b0-2929f61f5c79 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:09.221364 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-0cb2a14e-7f18-4efe-b3b0-2929f61f5c79 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:09.228567 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-92abba87-0f6e-4690-856f-518b0cb5fb4f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:09.332059 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-0cb2a14e-7f18-4efe-b3b0-2929f61f5c79 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Network a6c6ac39-c2dd-414b-b2c1-db0b208abb9a is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:15:09.425877 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-0cb2a14e-7f18-4efe-b3b0-2929f61f5c79 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:15:09.431264 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-0cb2a14e-7f18-4efe-b3b0-2929f61f5c79 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:15:09.437869 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-0cb2a14e-7f18-4efe-b3b0-2929f61f5c79 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:09.438476 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-0cb2a14e-7f18-4efe-b3b0-2929f61f5c79 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:09.465141 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cb2a14e-7f18-4efe-b3b0-2929f61f5c79 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Pushing event updated for resources: {'Port': ['ID=b52209fd-778b-498b-aa98-e818d0fee891,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:09.469254 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-0cb2a14e-7f18-4efe-b3b0-2929f61f5c79 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.241s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:09.485924 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-0cb2a14e-7f18-4efe-b3b0-2929f61f5c79 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.9018853
Jun 01 06:15:09.504818 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d05f682-ef54-456f-a0ff-2942ef97c6d9 req-b0a52fc8-e205-45c8-9fea-70b277a7c336 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:09.505513 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-5d05f682-ef54-456f-a0ff-2942ef97c6d9 req-b0a52fc8-e205-45c8-9fea-70b277a7c336 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Synchronizing usage tracker for tenant:dd97906039e7487cbb91b21981aa107c on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:15:09.511032 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Request body: {'port': {'device_id': '6d41e731-342f-457d-82c5-09f702557793', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79388'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:15:09.571685 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-5d05f682-ef54-456f-a0ff-2942ef97c6d9 req-b0a52fc8-e205-45c8-9fea-70b277a7c336 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Unset dirty status for tenant:dd97906039e7487cbb91b21981aa107c on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:15:09.572873 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5d05f682-ef54-456f-a0ff-2942ef97c6d9 req-b0a52fc8-e205-45c8-9fea-70b277a7c336 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=6d41e731-342f-457d-82c5-09f702557793 HTTP/1.1" status: 200  len: 932 time: 0.2968290
Jun 01 06:15:09.668314 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:09.680580 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5d05f682-ef54-456f-a0ff-2942ef97c6d9 req-b369ddb9-09f6-4cae-be7b-396fbf2e2064 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0785980
Jun 01 06:15:10.015719 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82bd5953-b6a4-4beb-84d0-19b037eca3dd req-3e606b64-0254-46f4-b56b-e027241c4078 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:10.017213 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-82bd5953-b6a4-4beb-84d0-19b037eca3dd req-3e606b64-0254-46f4-b56b-e027241c4078 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1809628
Jun 01 06:15:10.119411 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-82bd5953-b6a4-4beb-84d0-19b037eca3dd req-e6dbf839-ced9-4b30-ae71-2517b6ebb5c2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0921566
Jun 01 06:15:10.121490 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b52209fd-778b-498b-aa98-e818d0fee891 {{(pid=92229) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:15:10.129074 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:10.144330 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Transition to ACTIVE for port object b52209fd-778b-498b-aa98-e818d0fee891 will not be triggered until provisioned by entity L2. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:15:10.147908 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:10.152934 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ce554e3c-28b0-4dd7-b4a3-1e41fd5f3855 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:10.307733 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Pushing event updated for resources: {'Port': ['ID=b52209fd-778b-498b-aa98-e818d0fee891,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:10.351521 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:10.374656 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Attempting to bind port b52209fd-778b-498b-aa98-e818d0fee891 on host hv-cinder-79388 for vnic_type normal with profile  {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:15:10.374989 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Attempting to bind port b52209fd-778b-498b-aa98-e818d0fee891 by drivers openvswitch,hyperv on host hv-cinder-79388 at level 0 using segments [{'id': 'c333deab-77ad-4250-916e-537423452613', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 236, 'network_id': 'a6c6ac39-c2dd-414b-b2c1-db0b208abb9a'}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:15:10.375317 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Attempting to bind port b52209fd-778b-498b-aa98-e818d0fee891 on network a6c6ac39-c2dd-414b-b2c1-db0b208abb9a {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:15:10.390121 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Port b52209fd-778b-498b-aa98-e818d0fee891 on network a6c6ac39-c2dd-414b-b2c1-db0b208abb9a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79388 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 06:15:10.390487 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Attempting to bind port b52209fd-778b-498b-aa98-e818d0fee891 on network a6c6ac39-c2dd-414b-b2c1-db0b208abb9a {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:15:10.398960 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Checking agent: {'id': '56148394-2131-4d06-bcfa-c032301591b8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79388', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'started_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 14, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:15:10.399288 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Checking segment: {'id': 'c333deab-77ad-4250-916e-537423452613', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 236, 'network_id': 'a6c6ac39-c2dd-414b-b2c1-db0b208abb9a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:15:10.399699 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Bound using segment: {'id': 'c333deab-77ad-4250-916e-537423452613', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 236, 'network_id': 'a6c6ac39-c2dd-414b-b2c1-db0b208abb9a'} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:15:10.400152 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Bound port: b52209fd-778b-498b-aa98-e818d0fee891, host: hv-cinder-79388, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c333deab-77ad-4250-916e-537423452613', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 236, 'network_id': 'a6c6ac39-c2dd-414b-b2c1-db0b208abb9a'}}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:15:10.400497 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:10.481399 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06ac7c3f-e655-477b-80f7-6839c4573b67 req-bff00e92-8fb9-461b-96f5-01cd516524f2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:10.482831 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-06ac7c3f-e655-477b-80f7-6839c4573b67 req-bff00e92-8fb9-461b-96f5-01cd516524f2 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.48 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.1767135
Jun 01 06:15:10.562047 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] For port b52209fd-778b-498b-aa98-e818d0fee891, host hv-cinder-79388, cleared binding levels {{(pid=92229) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:15:10.576390 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] For port b52209fd-778b-498b-aa98-e818d0fee891, host hv-cinder-79388, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=b52209fd-778b-498b-aa98-e818d0fee891,segment=NetworkSegment(c333deab-77ad-4250-916e-537423452613),segment_id=c333deab-77ad-4250-916e-537423452613)] {{(pid=92229) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:15:10.610654 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:10.619286 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:10.695644 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:10.696370 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:10.697942 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] 10.222.0.48 "PUT /v2.0/ports/b52209fd-778b-498b-aa98-e818d0fee891 HTTP/1.1" status: 200  len: 1094 time: 1.2009430
Jun 01 06:15:10.698502 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6d41e731-342f-457d-82c5-09f702557793', 'tag': 'b52209fd-778b-498b-aa98-e818d0fee891'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:15:10.700906 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-642216dc-db52-45a4-83e9-dabc95952086" -d '{"events": [{"name": "network-changed", "server_uuid": "6d41e731-342f-457d-82c5-09f702557793", "tag": "b52209fd-778b-498b-aa98-e818d0fee891"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:15:10.723435 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Pushing event updated for resources: {'Port': ['ID=b52209fd-778b-498b-aa98-e818d0fee891,revision_number=3']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:10.728067 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:10.739073 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-06ac7c3f-e655-477b-80f7-6839c4573b67 req-aa2b47a7-1c07-4f7d-8df5-efdcc13b5f20 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Deleting port 5f320f89-ada2-472d-b9ac-0676b4c4b578 {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:15:10.739416 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-06ac7c3f-e655-477b-80f7-6839c4573b67 req-aa2b47a7-1c07-4f7d-8df5-efdcc13b5f20 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:10.797224 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:15:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a4176df9-e876-4dbc-b38d-1131eeb56bbc x-openstack-request-id: req-a4176df9-e876-4dbc-b38d-1131eeb56bbc {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:15:10.797539 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6d41e731-342f-457d-82c5-09f702557793", "tag": "b52209fd-778b-498b-aa98-e818d0fee891", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:15:10.797820 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-a4176df9-e876-4dbc-b38d-1131eeb56bbc {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:15:10.798244 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6d41e731-342f-457d-82c5-09f702557793', 'tag': 'b52209fd-778b-498b-aa98-e818d0fee891', 'status': 'completed', 'code': 200}
Jun 01 06:15:10.988742 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-06ac7c3f-e655-477b-80f7-6839c4573b67 req-aa2b47a7-1c07-4f7d-8df5-efdcc13b5f20 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] For port 5f320f89-ada2-472d-b9ac-0676b4c4b578, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=5f320f89-ada2-472d-b9ac-0676b4c4b578,segment=NetworkSegment(1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e),segment_id=1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:15:10.989099 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-06ac7c3f-e655-477b-80f7-6839c4573b67 req-aa2b47a7-1c07-4f7d-8df5-efdcc13b5f20 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:11.209048 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-8100b32e-28a3-4982-a972-3f0a9b610977 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:11.210531 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-8100b32e-28a3-4982-a972-3f0a9b610977 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=dd97906039e7487cbb91b21981aa107c&device_id=6d41e731-342f-457d-82c5-09f702557793 HTTP/1.1" status: 200  len: 1097 time: 0.4541252
Jun 01 06:15:11.217699 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-06ac7c3f-e655-477b-80f7-6839c4573b67 req-aa2b47a7-1c07-4f7d-8df5-efdcc13b5f20 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Calling delete_port for 5f320f89-ada2-472d-b9ac-0676b4c4b578 owned by compute:nova {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:15:11.221141 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:11.230012 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c92021ba-4acc-48b7-aefe-b119c1484540 req-0680ead2-d066-4bce-affa-c14609ede33a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:11.231546 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c92021ba-4acc-48b7-aefe-b119c1484540 req-0680ead2-d066-4bce-affa-c14609ede33a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=6d41e731-342f-457d-82c5-09f702557793 HTTP/1.1" status: 200  len: 944 time: 0.3776858
Jun 01 06:15:11.346441 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-c57d683d-f27a-44f8-8da4-c03448754743 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=b52209fd-778b-498b-aa98-e818d0fee891 HTTP/1.1" status: 200  len: 217 time: 0.1127250
Jun 01 06:15:11.454113 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c92021ba-4acc-48b7-aefe-b119c1484540 req-cbbd3bcf-c568-4a86-866e-f757cd8f7bbb tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1344354
Jun 01 06:15:11.467462 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-8210fc60-6753-43fb-8d5a-a164e786e54b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:11.468903 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-8210fc60-6753-43fb-8d5a-a164e786e54b service neutron] 10.222.0.48 "GET /v2.0/subnets?id=c6893b02-9e5e-4658-acac-8bef895b0956 HTTP/1.1" status: 200  len: 848 time: 0.1139445
Jun 01 06:15:11.530313 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-732e24e9-cec9-42d3-b2c4-75f381263f7a service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=a6c6ac39-c2dd-414b-b2c1-db0b208abb9a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0534778
Jun 01 06:15:11.538769 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd5f7a9-c770-4248-8a1d-b1f5665d96d2 req-34490b50-8743-4e7f-9a58-904f0571783a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:11.540335 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3dd5f7a9-c770-4248-8a1d-b1f5665d96d2 req-34490b50-8743-4e7f-9a58-904f0571783a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/ports?device_id=dc8bf0a9-503e-487c-975a-ec720e525cf1 HTTP/1.1" status: 200  len: 945 time: 0.3056819
Jun 01 06:15:11.715362 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:15:11.728219 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3dd5f7a9-c770-4248-8a1d-b1f5665d96d2 req-1872cdaa-bb60-4b47-8818-73a5188c4e7d tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.25 "GET /v2.0/security-groups?id=d0ab3203-d9c6-4a65-bc8f-4630202ec93a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1595864
Jun 01 06:15:11.761794 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-06ac7c3f-e655-477b-80f7-6839c4573b67 req-aa2b47a7-1c07-4f7d-8df5-efdcc13b5f20 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:11.769489 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-0cb2a14e-7f18-4efe-b3b0-2929f61f5c79 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:11.776451 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['5f320f89-ada2-472d-b9ac-0676b4c4b578'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:15:11.820594 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-f391f694-74a9-496d-8db2-26edca6f0653 service neutron] 10.222.0.48 "GET /v2.0/networks/a6c6ac39-c2dd-414b-b2c1-db0b208abb9a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2773912
Jun 01 06:15:11.821613 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa2b47a7-1c07-4f7d-8df5-efdcc13b5f20 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Pushing event deleted for resources: {'Port': ['ID=5f320f89-ada2-472d-b9ac-0676b4c4b578,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:11.824597 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-aa2b47a7-1c07-4f7d-8df5-efdcc13b5f20 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:11.971884 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-06ac7c3f-e655-477b-80f7-6839c4573b67 req-aa2b47a7-1c07-4f7d-8df5-efdcc13b5f20 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] No DVR routers for this DVR port 5f320f89-ada2-472d-b9ac-0676b4c4b578 on host hv-cinder-79388 {{(pid=92229) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:15:11.982921 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-06ac7c3f-e655-477b-80f7-6839c4573b67 req-aa2b47a7-1c07-4f7d-8df5-efdcc13b5f20 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:11.997488 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-06ac7c3f-e655-477b-80f7-6839c4573b67 req-aa2b47a7-1c07-4f7d-8df5-efdcc13b5f20 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] 10.222.0.48 "DELETE /v2.0/ports/5f320f89-ada2-472d-b9ac-0676b4c4b578 HTTP/1.1" status: 204  len: 173 time: 1.5005703
Jun 01 06:15:12.011469 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 36436) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:12.037521 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d142c9c-ad01-4ba2-932a-bb4d908ce2c0 req-dd322ce2-6eba-4da9-bd64-40e49d5c7e57 service neutron] 10.222.0.48 "GET /v2.0/networks/a6c6ac39-c2dd-414b-b2c1-db0b208abb9a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1833990
Jun 01 06:15:12.144113 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-fcc051ee-cc52-42f7-be1c-353400152264 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:12.160519 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-fcc051ee-cc52-42f7-be1c-353400152264 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:12.160908 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-642216dc-db52-45a4-83e9-dabc95952086 req-b0a05646-68b9-4072-a2e0-8e285fcf9908 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:12.162483 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-642216dc-db52-45a4-83e9-dabc95952086 req-b0a05646-68b9-4072-a2e0-8e285fcf9908 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=dd97906039e7487cbb91b21981aa107c&device_id=6d41e731-342f-457d-82c5-09f702557793 HTTP/1.1" status: 200  len: 1097 time: 0.0780895
Jun 01 06:15:12.164584 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-fcc051ee-cc52-42f7-be1c-353400152264 admin admin] Usage tracker for resource:security_group_rule and tenant:babd64e040d541faab4aea81f3a891ca is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:12.168180 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-fcc051ee-cc52-42f7-be1c-353400152264 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:12.173970 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-fcc051ee-cc52-42f7-be1c-353400152264 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:12.261324 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-fcc051ee-cc52-42f7-be1c-353400152264 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:12.265442 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-fcc051ee-cc52-42f7-be1c-353400152264 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:12.273198 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:12.315983 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcc051ee-cc52-42f7-be1c-353400152264 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=95e08df6-6f5e-4b0f-a310-a85c2982ec17,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:12.316419 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-642216dc-db52-45a4-83e9-dabc95952086 req-ea77e008-ba4e-4df3-a2df-ae3719ba68d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:12.317844 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-642216dc-db52-45a4-83e9-dabc95952086 req-ea77e008-ba4e-4df3-a2df-ae3719ba68d9 service neutron] 10.222.0.48 "GET /v2.0/networks?id=a6c6ac39-c2dd-414b-b2c1-db0b208abb9a HTTP/1.1" status: 200  len: 909 time: 0.1416094
Jun 01 06:15:12.320365 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-fcc051ee-cc52-42f7-be1c-353400152264 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=babd64e040d541faab4aea81f3a891ca&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3075287
Jun 01 06:15:12.321272 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-fcc051ee-cc52-42f7-be1c-353400152264 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:12.323580 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 36442) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:12.344271 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-8568402b-f766-4727-a456-bbcb33b487be None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:12.382974 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b08b002e-f3f5-4c4a-9a12-24774db844c1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:12.392312 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-642216dc-db52-45a4-83e9-dabc95952086 req-e67b73c7-b363-4f57-9cff-4bedb9fbc515 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=b52209fd-778b-498b-aa98-e818d0fee891 HTTP/1.1" status: 200  len: 217 time: 0.0668743
Jun 01 06:15:12.410802 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b08b002e-f3f5-4c4a-9a12-24774db844c1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:12.462092 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-642216dc-db52-45a4-83e9-dabc95952086 req-5d9a55fd-aa54-4422-ad21-976f727fe4a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:12.463674 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-642216dc-db52-45a4-83e9-dabc95952086 req-5d9a55fd-aa54-4422-ad21-976f727fe4a7 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=c6893b02-9e5e-4658-acac-8bef895b0956 HTTP/1.1" status: 200  len: 848 time: 0.0646381
Jun 01 06:15:12.467361 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b08b002e-f3f5-4c4a-9a12-24774db844c1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:12.471378 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-14030fd4-6bf8-446d-a886-7ed3772b4b6c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:12.488576 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b08b002e-f3f5-4c4a-9a12-24774db844c1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=95e08df6-6f5e-4b0f-a310-a85c2982ec17,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:12.497140 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-b08b002e-f3f5-4c4a-9a12-24774db844c1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:12.501988 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b08b002e-f3f5-4c4a-9a12-24774db844c1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:12.523352 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-b08b002e-f3f5-4c4a-9a12-24774db844c1 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/95e08df6-6f5e-4b0f-a310-a85c2982ec17 HTTP/1.1" status: 204  len: 168 time: 0.1986148
Jun 01 06:15:12.535921 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-642216dc-db52-45a4-83e9-dabc95952086 req-78766c2a-79ac-4f3f-9fda-c99d2173bc82 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=a6c6ac39-c2dd-414b-b2c1-db0b208abb9a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0587919
Jun 01 06:15:12.754664 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-642216dc-db52-45a4-83e9-dabc95952086 req-aee66511-a98c-4171-8ee7-90855f8bce5b service neutron] 10.222.0.48 "GET /v2.0/networks/a6c6ac39-c2dd-414b-b2c1-db0b208abb9a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2118595
Jun 01 06:15:12.768426 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9931faf-94da-4965-8dbb-6ea45d7833ad req-2b23774e-6f4a-403d-abb1-768bcc875a8c tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:12.769822 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f9931faf-94da-4965-8dbb-6ea45d7833ad req-2b23774e-6f4a-403d-abb1-768bcc875a8c tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=6d41e731-342f-457d-82c5-09f702557793 HTTP/1.1" status: 200  len: 944 time: 0.1877990
Jun 01 06:15:12.830022 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 36454) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:12.893658 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dc8bf0a9-503e-487c-975a-ec720e525cf1', 'name': 'network-vif-deleted', 'tag': '5f320f89-ada2-472d-b9ac-0676b4c4b578'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:15:12.896084 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8bd240c3-3e39-42a0-9064-e523b8054c08" -d '{"events": [{"server_uuid": "dc8bf0a9-503e-487c-975a-ec720e525cf1", "name": "network-vif-deleted", "tag": "5f320f89-ada2-472d-b9ac-0676b4c4b578"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:15:12.961359 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 36462) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:12.974358 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:15:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ff640f42-e830-4418-a5f8-b006fcd0a8b3 x-openstack-request-id: req-ff640f42-e830-4418-a5f8-b006fcd0a8b3 {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:15:12.974675 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dc8bf0a9-503e-487c-975a-ec720e525cf1", "name": "network-vif-deleted", "tag": "5f320f89-ada2-472d-b9ac-0676b4c4b578", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:15:12.974950 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-ff640f42-e830-4418-a5f8-b006fcd0a8b3 {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:15:12.975355 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dc8bf0a9-503e-487c-975a-ec720e525cf1', 'name': 'network-vif-deleted', 'tag': '5f320f89-ada2-472d-b9ac-0676b4c4b578', 'status': 'completed', 'code': 200}
Jun 01 06:15:13.014146 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3dc27a7d-f6f5-4352-86b9-60af758125d6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:13.043247 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f9931faf-94da-4965-8dbb-6ea45d7833ad req-8f2b3c1b-a47a-4bfe-9e5b-c6642739df21 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2482369
Jun 01 06:15:13.055372 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-3dc27a7d-f6f5-4352-86b9-60af758125d6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:13.063753 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-3dc27a7d-f6f5-4352-86b9-60af758125d6 admin admin] Usage tracker for resource:security_group_rule and tenant:bc27bc7fcff24287999d3ffc63f6caea is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:13.068547 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-3dc27a7d-f6f5-4352-86b9-60af758125d6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:13.085496 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-3dc27a7d-f6f5-4352-86b9-60af758125d6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:13.095220 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-642216dc-db52-45a4-83e9-dabc95952086 req-dab19bb6-6d02-4974-9376-8ae245e884f3 service neutron] 10.222.0.48 "GET /v2.0/networks/a6c6ac39-c2dd-414b-b2c1-db0b208abb9a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3244374
Jun 01 06:15:13.180547 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3dc27a7d-f6f5-4352-86b9-60af758125d6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:13.184854 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3dc27a7d-f6f5-4352-86b9-60af758125d6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:13.192282 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b76ba254-6de0-4716-8524-72d4f249d099 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:13.233221 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dc27a7d-f6f5-4352-86b9-60af758125d6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3374b8a5-fdc4-4157-ac51-8f0edb800375,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:13.236304 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-3dc27a7d-f6f5-4352-86b9-60af758125d6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:13.238933 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-3dc27a7d-f6f5-4352-86b9-60af758125d6 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=bc27bc7fcff24287999d3ffc63f6caea&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2766204
Jun 01 06:15:13.241623 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 36466) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:13.261022 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:13.308531 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-849282fa-bacc-4a9a-8942-79cf1bcd37f6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:13.335240 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-849282fa-bacc-4a9a-8942-79cf1bcd37f6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:13.388991 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-849282fa-bacc-4a9a-8942-79cf1bcd37f6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:13.394240 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-84cc4973-ff52-4e9a-b21c-cfc948849ac2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:13.407807 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-849282fa-bacc-4a9a-8942-79cf1bcd37f6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3374b8a5-fdc4-4157-ac51-8f0edb800375,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:13.410398 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-849282fa-bacc-4a9a-8942-79cf1bcd37f6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:13.411584 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-849282fa-bacc-4a9a-8942-79cf1bcd37f6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:13.415528 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-849282fa-bacc-4a9a-8942-79cf1bcd37f6 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/3374b8a5-fdc4-4157-ac51-8f0edb800375 HTTP/1.1" status: 204  len: 168 time: 0.1728652
Jun 01 06:15:13.468340 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-379ff57d-7b82-4604-b21c-d86ee10e14e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-744138'] for router_interface, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:13.882863 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-379ff57d-7b82-4604-b21c-d86ee10e14e9 admin admin] Deleting port 5a0fb2e6-0298-4b76-b4ad-e89873a54e08 {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:15:13.883203 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-379ff57d-7b82-4604-b21c-d86ee10e14e9 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:14.020807 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [None req-379ff57d-7b82-4604-b21c-d86ee10e14e9 admin admin] For port 5a0fb2e6-0298-4b76-b4ad-e89873a54e08, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=5a0fb2e6-0298-4b76-b4ad-e89873a54e08,segment=NetworkSegment(1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e),segment_id=1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e)] {{(pid=92230) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:15:14.021114 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-379ff57d-7b82-4604-b21c-d86ee10e14e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:14.140237 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device b52209fd-778b-498b-aa98-e818d0fee891 details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:15:14.147040 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 5f320f89-ada2-472d-b9ac-0676b4c4b578 no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:15:14.153004 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-379ff57d-7b82-4604-b21c-d86ee10e14e9 admin admin] Calling delete_port for 5a0fb2e6-0298-4b76-b4ad-e89873a54e08 owned by network:router_interface {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:15:14.188254 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] No Port match for: 5f320f89-ada2-472d-b9ac-0676b4c4b578 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:15:14.192109 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 5f320f89-ada2-472d-b9ac-0676b4c4b578 not bound to the agent host hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:15:14.195837 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 36492) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:14.247952 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8055c083-3110-4561-8429-e20387440b2b req-ed834c05-91ec-4a19-b281-81d228aeeab6 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:14.255400 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8055c083-3110-4561-8429-e20387440b2b req-ed834c05-91ec-4a19-b281-81d228aeeab6 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=6d41e731-342f-457d-82c5-09f702557793 HTTP/1.1" status: 200  len: 944 time: 0.0976870
Jun 01 06:15:14.310890 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8055c083-3110-4561-8429-e20387440b2b req-aac8b65e-a796-44d5-bc45-1046c00d9182 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0544770
Jun 01 06:15:14.340829 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-779934187-network', 'tenant_id': '38cfd48899ed4a7e885330603ad8b8d1'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:15:14.346105 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:14.349999 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Usage tracker for resource:network and tenant:38cfd48899ed4a7e885330603ad8b8d1 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:14.352873 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:14.353895 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port b52209fd-778b-498b-aa98-e818d0fee891, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=b52209fd-778b-498b-aa98-e818d0fee891,segment=NetworkSegment(c333deab-77ad-4250-916e-537423452613),segment_id=c333deab-77ad-4250-916e-537423452613)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:15:14.359348 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:14.368519 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': 'b52209fd-778b-498b-aa98-e818d0fee891', 'network_id': 'a6c6ac39-c2dd-414b-b2c1-db0b208abb9a', 'port_id': 'b52209fd-778b-498b-aa98-e818d0fee891', 'mac_address': 'fa:16:3e:d0:0a:2b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 236, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c6893b02-9e5e-4658-acac-8bef895b0956', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:15:14.375472 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Made reservation on behalf of 38cfd48899ed4a7e885330603ad8b8d1 for: {'network': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:15:14.377799 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-8110114'] for network, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:14.390822 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:14.409424 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:14.413385 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Usage tracker for resource:security_group_rule and tenant:38cfd48899ed4a7e885330603ad8b8d1 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:14.416326 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:14.423621 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:14.428442 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:14.450385 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b52209fd-778b-498b-aa98-e818d0fee891 {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:15:14.471723 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-379ff57d-7b82-4604-b21c-d86ee10e14e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:14.472943 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port b52209fd-778b-498b-aa98-e818d0fee891, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=b52209fd-778b-498b-aa98-e818d0fee891,segment=NetworkSegment(c333deab-77ad-4250-916e-537423452613),segment_id=c333deab-77ad-4250-916e-537423452613)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:15:14.476603 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:14.476764 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:14.478506 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:14.515469 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:14.520720 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-379ff57d-7b82-4604-b21c-d86ee10e14e9 admin admin] Pushing event deleted for resources: {'Port': ['ID=5a0fb2e6-0298-4b76-b4ad-e89873a54e08,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:14.522699 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:14.529786 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-849282fa-bacc-4a9a-8942-79cf1bcd37f6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:14.552307 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-379ff57d-7b82-4604-b21c-d86ee10e14e9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:14.554063 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=b52209fd-778b-498b-aa98-e818d0fee891,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:14.557391 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:14.564882 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] vlan segment allocate from pool success with {'vlan_id': 203, 'physical_network': 'physnet1'}  {{(pid=92229) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 06:15:14.570383 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=90d2c0d8-2deb-40fa-a61d-e1397f11a27c,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:14.574321 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:14.580461 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:14.580783 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.db.segments_db [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Added segment 92215424-bdde-4f41-a802-40025f30d832 of type vlan for network bae00e81-19b5-4fe7-a773-a08e675104fd
Jun 01 06:15:14.610664 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8788496565589'] for network, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:14.647119 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104'] for network, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:14.648505 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:14.649086 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:14.652809 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:14.762418 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 0.5634587
Jun 01 06:15:14.763867 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 36498) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:14.765036 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['b52209fd-778b-498b-aa98-e818d0fee891'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:15:14.766743 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Pushing event updated for resources: {'Network': ['ID=bae00e81-19b5-4fe7-a773-a08e675104fd,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:14.769678 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:14.773554 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-e1466444-3c5e-4bb5-ad6b-f8a0066d83ea admin admin] Request body: {'subnet': {'network_id': 'bae00e81-19b5-4fe7-a773-a08e675104fd', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-779934187-subnet', 'tenant_id': '38cfd48899ed4a7e885330603ad8b8d1', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:15:14.779065 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-e1466444-3c5e-4bb5-ad6b-f8a0066d83ea admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:14.783196 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-e1466444-3c5e-4bb5-ad6b-f8a0066d83ea admin admin] Usage tracker for resource:subnet and tenant:38cfd48899ed4a7e885330603ad8b8d1 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:14.786263 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-e1466444-3c5e-4bb5-ad6b-f8a0066d83ea admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:14.793493 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-e1466444-3c5e-4bb5-ad6b-f8a0066d83ea admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:14.794509 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Network bae00e81-19b5-4fe7-a773-a08e675104fd details requested by agent ovs-agent-dv-cinder-793885-1-iscsi with host dv-cinder-793885-1-iscsi {{(pid=92231) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 06:15:14.804109 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e1466444-3c5e-4bb5-ad6b-f8a0066d83ea admin admin] Made reservation on behalf of 38cfd48899ed4a7e885330603ad8b8d1 for: {'subnet': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:15:14.806743 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e1466444-3c5e-4bb5-ad6b-f8a0066d83ea admin admin] Notify callbacks [] for subnet, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:14.907689 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-379ff57d-7b82-4604-b21c-d86ee10e14e9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-581113', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-746586'] for router_interface, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:15.252683 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e1466444-3c5e-4bb5-ad6b-f8a0066d83ea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099'] for subnet, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:15.256698 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:15.303430 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-379ff57d-7b82-4604-b21c-d86ee10e14e9 admin admin] Router ea184dcf-09ad-4302-82aa-16ce19e6c1e5 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92230) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:15:15.329973 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1466444-3c5e-4bb5-ad6b-f8a0066d83ea admin admin] Pushing event updated for resources: {'Subnet': ['ID=0d90443d-758c-4b5b-b23f-0afae18a4b8b,revision_number=0']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:15.334015 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-e1466444-3c5e-4bb5-ad6b-f8a0066d83ea admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:15.349511 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1466444-3c5e-4bb5-ad6b-f8a0066d83ea admin admin] Checking segment: {'id': '92215424-bdde-4f41-a802-40025f30d832', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 203, 'network_id': 'bae00e81-19b5-4fe7-a773-a08e675104fd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:15:15.349860 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e1466444-3c5e-4bb5-ad6b-f8a0066d83ea admin admin] Network hostable DHCP agents. Network: bae00e81-19b5-4fe7-a773-a08e675104fd, hostable agents: ['648832f0-f26e-4e29-ac0d-d97e4a75c6c4'], hosted agents: [] {{(pid=92229) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 06:15:15.361505 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:15.368113 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e1466444-3c5e-4bb5-ad6b-f8a0066d83ea admin admin] Network bae00e81-19b5-4fe7-a773-a08e675104fd is scheduled to be hosted by DHCP agent 648832f0-f26e-4e29-ac0d-d97e4a75c6c4 with binding_index 1 {{(pid=92229) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 06:15:15.378214 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-e1466444-3c5e-4bb5-ad6b-f8a0066d83ea admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793885-1-iscsi, bae00e81-19b5-4fe7-a773-a08e675104fd) {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:15:15.383434 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e1466444-3c5e-4bb5-ad6b-f8a0066d83ea admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:15.384084 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e1466444-3c5e-4bb5-ad6b-f8a0066d83ea admin admin] Notify callbacks [] for subnet, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:15.394504 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-650f5d0f-0302-44a6-9735-34300c8a7e64 None None] Network bae00e81-19b5-4fe7-a773-a08e675104fd requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:15:15.411345 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-e1466444-3c5e-4bb5-ad6b-f8a0066d83ea admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.6463737
Jun 01 06:15:15.547320 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-379ff57d-7b82-4604-b21c-d86ee10e14e9 admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:15:15.548794 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07ec2fae-6115-44e2-88d0-b8487877bd58 req-9d7ab414-b29e-48df-8571-8c27cd014cbb tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:15.559130 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-34f219cc-0dff-446e-a5f1-2820cd805ae9 None None] Sync routers for ids ['ea184dcf-09ad-4302-82aa-16ce19e6c1e5'] in dv-cinder-793885-1-iscsi {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:15:15.563934 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-07ec2fae-6115-44e2-88d0-b8487877bd58 req-9d7ab414-b29e-48df-8571-8c27cd014cbb tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=6d41e731-342f-457d-82c5-09f702557793 HTTP/1.1" status: 200  len: 945 time: 0.1255484
Jun 01 06:15:15.571090 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-379ff57d-7b82-4604-b21c-d86ee10e14e9 admin admin] 10.222.0.25 "PUT /v2.0/routers/ea184dcf-09ad-4302-82aa-16ce19e6c1e5/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7399468
Jun 01 06:15:15.575868 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 36508) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:15.594629 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34f219cc-0dff-446e-a5f1-2820cd805ae9 None None] Routers {'ea184dcf-09ad-4302-82aa-16ce19e6c1e5'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:15:15.595264 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-34f219cc-0dff-446e-a5f1-2820cd805ae9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2991b80>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:15:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['ea184dcf-09ad-4302-82aa-16ce19e6c1e5'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:15.621598 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-07ec2fae-6115-44e2-88d0-b8487877bd58 req-78fa6c4c-a312-4fd8-b074-cdc75a04e4f8 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0418363
Jun 01 06:15:15.665335 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd9c6c16-6cf6-4a4c-85e7-9b7432e5c138 None None] Network bae00e81-19b5-4fe7-a773-a08e675104fd requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:15:15.794491 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4fc0138e-fa55-4619-a71e-2e61d594351f admin admin] Notify callbacks [] for router, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:15.884876 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-34f219cc-0dff-446e-a5f1-2820cd805ae9 None None] Set router ea184dcf-09ad-4302-82aa-16ce19e6c1e5 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:15:15.964506 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:15.987983 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4fc0138e-fa55-4619-a71e-2e61d594351f admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:16.090146 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-4fc0138e-fa55-4619-a71e-2e61d594351f admin admin] Deleting port e157eec0-3394-4fbf-8701-c05f500f506a {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:15:16.090494 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4fc0138e-fa55-4619-a71e-2e61d594351f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:16.123913 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 36522) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:16.129543 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1985858809-network', 'tenant_id': '8656d220516c4779a9293fb82708033e'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:15:16.134021 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:16.138184 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Usage tracker for resource:network and tenant:8656d220516c4779a9293fb82708033e is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:16.141310 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:16.147124 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:16.158171 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Made reservation on behalf of 8656d220516c4779a9293fb82708033e for: {'network': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:15:16.159610 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device b52209fd-778b-498b-aa98-e818d0fee891 up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:15:16.160986 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-8110114'] for network, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:16.176063 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:16.192970 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:16.198042 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Usage tracker for resource:security_group_rule and tenant:8656d220516c4779a9293fb82708033e is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:16.201489 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:16.208528 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:16.223464 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-34f219cc-0dff-446e-a5f1-2820cd805ae9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2991b80>, [{'id': 'ea184dcf-09ad-4302-82aa-16ce19e6c1e5', 'name': 'tempest-ServerRescueNegativeTestJSON-979777158-router', 'tenant_id': '8f1cf739e243401eb5da7ee705e856de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.222'}], 'enable_snat': True}, 'gw_port_id': 'e157eec0-3394-4fbf-8701-c05f500f506a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:15:14Z', 'revision_number': 5, 'project_id': '8f1cf739e243401eb5da7ee705e856de', 'gw_port': {'id': 'e157eec0-3394-4fbf-8701-c05f500f506a', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:84:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea184dcf-09ad-4302-82aa-16ce19e6c1e5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.222', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:29Z', 'updated_at': '2021-06-01T06:11:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:16.228661 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-34f219cc-0dff-446e-a5f1-2820cd805ae9 None None] Checking router: ea184dcf-09ad-4302-82aa-16ce19e6c1e5 for host: dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:15:16.241387 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34f219cc-0dff-446e-a5f1-2820cd805ae9 None None] Routers {'ea184dcf-09ad-4302-82aa-16ce19e6c1e5'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:15:16.242742 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-34f219cc-0dff-446e-a5f1-2820cd805ae9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2991b80>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:15:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['ea184dcf-09ad-4302-82aa-16ce19e6c1e5'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:16.247265 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning for port b52209fd-778b-498b-aa98-e818d0fee891 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:15:16.253353 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port b52209fd-778b-498b-aa98-e818d0fee891 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:15:16.254207 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:16.325281 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:16.329914 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:16.334310 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-95a94d9d-5032-4277-81f0-f68620cc9f01 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:16.360535 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [None req-4fc0138e-fa55-4619-a71e-2e61d594351f admin admin] For port e157eec0-3394-4fbf-8701-c05f500f506a, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=e157eec0-3394-4fbf-8701-c05f500f506a,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92230) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:15:16.361113 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4fc0138e-fa55-4619-a71e-2e61d594351f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:16.384843 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bca41759-2a83-4b36-b450-633ce6b1dad6,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:16.388293 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] vlan segment allocate from pool success with {'vlan_id': 223, 'physical_network': 'physnet1'}  {{(pid=92229) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 06:15:16.391034 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:16.401675 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:16.402472 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.db.segments_db [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Added segment c881206a-23ee-4c3a-a184-5698c6d130b6 of type vlan for network 63aca663-c8c2-4fea-af09-2f342cd07692
Jun 01 06:15:16.409387 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:16.425809 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-34f219cc-0dff-446e-a5f1-2820cd805ae9 None None] Set router ea184dcf-09ad-4302-82aa-16ce19e6c1e5 gateway port host: None {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:15:16.438468 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8788496565589'] for network, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:16.444419 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6d41e731-342f-457d-82c5-09f702557793', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b52209fd-778b-498b-aa98-e818d0fee891'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:15:16.448147 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-379e3fa5-1d8e-48bd-8409-4ca206ae806d" -d '{"events": [{"server_uuid": "6d41e731-342f-457d-82c5-09f702557793", "name": "network-vif-plugged", "status": "completed", "tag": "b52209fd-778b-498b-aa98-e818d0fee891"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:15:16.457222 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port b52209fd-778b-498b-aa98-e818d0fee891, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=b52209fd-778b-498b-aa98-e818d0fee891,segment=NetworkSegment(c333deab-77ad-4250-916e-537423452613),segment_id=c333deab-77ad-4250-916e-537423452613)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:15:16.465125 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:16.470465 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:16.475672 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104'] for network, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:16.476385 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:16.477017 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:16.483753 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:16.554169 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:15:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-321480bc-9e01-40ae-86f5-6a271d51589c x-openstack-request-id: req-321480bc-9e01-40ae-86f5-6a271d51589c {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:15:16.554874 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-4fc0138e-fa55-4619-a71e-2e61d594351f admin admin] Calling delete_port for e157eec0-3394-4fbf-8701-c05f500f506a owned by network:router_gateway {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:15:16.555427 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6d41e731-342f-457d-82c5-09f702557793", "name": "network-vif-plugged", "status": "completed", "tag": "b52209fd-778b-498b-aa98-e818d0fee891", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:15:16.555804 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-34f219cc-0dff-446e-a5f1-2820cd805ae9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2991b80>, [{'id': 'ea184dcf-09ad-4302-82aa-16ce19e6c1e5', 'name': 'tempest-ServerRescueNegativeTestJSON-979777158-router', 'tenant_id': '8f1cf739e243401eb5da7ee705e856de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:15:15Z', 'revision_number': 6, 'project_id': '8f1cf739e243401eb5da7ee705e856de', 'gw_port_host': None}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:16.556067 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-321480bc-9e01-40ae-86f5-6a271d51589c {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:15:16.556634 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6d41e731-342f-457d-82c5-09f702557793', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b52209fd-778b-498b-aa98-e818d0fee891', 'code': 200}
Jun 01 06:15:16.560724 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-34f219cc-0dff-446e-a5f1-2820cd805ae9 None None] The sync data for ids ['ea184dcf-09ad-4302-82aa-16ce19e6c1e5'] in dv-cinder-793885-1-iscsi is: [{'id': 'ea184dcf-09ad-4302-82aa-16ce19e6c1e5', 'name': 'tempest-ServerRescueNegativeTestJSON-979777158-router', 'tenant_id': '8f1cf739e243401eb5da7ee705e856de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:15:15Z', 'revision_number': 6, 'project_id': '8f1cf739e243401eb5da7ee705e856de', 'gw_port_host': None}] {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:15:16.597078 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Pushing event updated for resources: {'Network': ['ID=63aca663-c8c2-4fea-af09-2f342cd07692,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:16.607129 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:16.614174 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.4890044
Jun 01 06:15:16.616876 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 36528) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:16.622142 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=b52209fd-778b-498b-aa98-e818d0fee891,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:16.633152 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Network 63aca663-c8c2-4fea-af09-2f342cd07692 details requested by agent ovs-agent-dv-cinder-793885-1-iscsi with host dv-cinder-793885-1-iscsi {{(pid=92231) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 06:15:16.636559 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-8e6e0f58-377c-4ca2-9f59-858958cb54b9 admin admin] Request body: {'subnet': {'network_id': '63aca663-c8c2-4fea-af09-2f342cd07692', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1985858809-subnet', 'tenant_id': '8656d220516c4779a9293fb82708033e', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:15:16.639077 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:16.644013 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-8e6e0f58-377c-4ca2-9f59-858958cb54b9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:16.656158 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-8e6e0f58-377c-4ca2-9f59-858958cb54b9 admin admin] Usage tracker for resource:subnet and tenant:8656d220516c4779a9293fb82708033e is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:16.661659 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-8e6e0f58-377c-4ca2-9f59-858958cb54b9 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:16.672563 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-8e6e0f58-377c-4ca2-9f59-858958cb54b9 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:16.697532 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8e6e0f58-377c-4ca2-9f59-858958cb54b9 admin admin] Made reservation on behalf of 8656d220516c4779a9293fb82708033e for: {'subnet': 1} {{(pid=92230) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:15:16.701167 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8e6e0f58-377c-4ca2-9f59-858958cb54b9 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1981512'] for subnet, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:16.868535 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4fc0138e-fa55-4619-a71e-2e61d594351f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:16.874658 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:16.887874 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a9aeeaa-33e9-4c55-b08c-c943ee22bddd req-0853ef0a-5deb-4725-9b80-debc2e127512 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:16.889351 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0a9aeeaa-33e9-4c55-b08c-c943ee22bddd req-0853ef0a-5deb-4725-9b80-debc2e127512 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=6d41e731-342f-457d-82c5-09f702557793 HTTP/1.1" status: 200  len: 946 time: 0.1043162
Jun 01 06:15:16.892187 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ad96308-c686-4899-baa5-3e7e576fd95a req-185a6e69-d957-4ee4-af36-7f1ea9b39d28 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:16.893553 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2ad96308-c686-4899-baa5-3e7e576fd95a req-185a6e69-d957-4ee4-af36-7f1ea9b39d28 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=6d41e731-342f-457d-82c5-09f702557793 HTTP/1.1" status: 200  len: 1099 time: 0.1485980
Jun 01 06:15:16.959258 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fc0138e-fa55-4619-a71e-2e61d594351f admin admin] Pushing event deleted for resources: {'Port': ['ID=e157eec0-3394-4fbf-8701-c05f500f506a,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:16.961824 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-4fc0138e-fa55-4619-a71e-2e61d594351f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:17.048949 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0a9aeeaa-33e9-4c55-b08c-c943ee22bddd req-d96cf6cd-22b9-4230-b0da-ceb9fee48833 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1536825
Jun 01 06:15:17.053409 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2ad96308-c686-4899-baa5-3e7e576fd95a req-7985697f-fbd1-4bb3-8d66-b364f233d07c service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1400096
Jun 01 06:15:17.070264 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4fc0138e-fa55-4619-a71e-2e61d594351f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-745687'] for router_gateway, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:17.275038 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4fc0138e-fa55-4619-a71e-2e61d594351f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-748122', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-727'] for router, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:17.279459 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4fc0138e-fa55-4619-a71e-2e61d594351f admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:17.383033 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4fc0138e-fa55-4619-a71e-2e61d594351f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-746854'] for router, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:17.383553 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4fc0138e-fa55-4619-a71e-2e61d594351f admin admin] Fanout notify agent at l3_agent the message router_deleted on router ea184dcf-09ad-4302-82aa-16ce19e6c1e5 {{(pid=92230) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 06:15:17.462705 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4fc0138e-fa55-4619-a71e-2e61d594351f admin admin] Notify callbacks [] for router, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:17.466504 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-4fc0138e-fa55-4619-a71e-2e61d594351f admin admin] 10.222.0.25 "DELETE /v2.0/routers/ea184dcf-09ad-4302-82aa-16ce19e6c1e5 HTTP/1.1" status: 204  len: 168 time: 1.8869264
Jun 01 06:15:17.466861 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 36534) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:17.531682 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_v2 [None req-27567abe-eed4-4e64-9a3e-b3c03f631151 admin admin] Deleting subnet 84c296fc-69c0-46e2-b1ed-e3edf435b759 {{(pid=92229) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 06:15:17.534728 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-27567abe-eed4-4e64-9a3e-b3c03f631151 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:17.576099 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8e6e0f58-377c-4ca2-9f59-858958cb54b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2445565', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1981534'] for subnet, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:17.581910 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-921b18b6-42e2-4a4c-b352-c3fa15ac613c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:17.591453 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-27567abe-eed4-4e64-9a3e-b3c03f631151 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:17.598983 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-27567abe-eed4-4e64-9a3e-b3c03f631151 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8086245'] for subnet, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:17.659060 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e6e0f58-377c-4ca2-9f59-858958cb54b9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1c45f0c4-a67f-4949-992d-a757835e7a77,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:17.664686 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-8e6e0f58-377c-4ca2-9f59-858958cb54b9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:17.665378 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e6e0f58-377c-4ca2-9f59-858958cb54b9 admin admin] Checking segment: {'id': 'c881206a-23ee-4c3a-a184-5698c6d130b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 223, 'network_id': '63aca663-c8c2-4fea-af09-2f342cd07692'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92230) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:15:17.665752 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8e6e0f58-377c-4ca2-9f59-858958cb54b9 admin admin] Network hostable DHCP agents. Network: 63aca663-c8c2-4fea-af09-2f342cd07692, hostable agents: ['648832f0-f26e-4e29-ac0d-d97e4a75c6c4'], hosted agents: [] {{(pid=92230) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 06:15:17.685470 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8e6e0f58-377c-4ca2-9f59-858958cb54b9 admin admin] Network 63aca663-c8c2-4fea-af09-2f342cd07692 is scheduled to be hosted by DHCP agent 648832f0-f26e-4e29-ac0d-d97e4a75c6c4 with binding_index 1 {{(pid=92230) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 06:15:17.696803 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-8e6e0f58-377c-4ca2-9f59-858958cb54b9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793885-1-iscsi, 63aca663-c8c2-4fea-af09-2f342cd07692) {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:15:17.706211 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc6820f0-de76-47f0-9ddc-e155c2ad56d8 None None] Network 63aca663-c8c2-4fea-af09-2f342cd07692 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:15:17.712880 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e6e0f58-377c-4ca2-9f59-858958cb54b9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:17.713515 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8e6e0f58-377c-4ca2-9f59-858958cb54b9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:17.746558 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-8e6e0f58-377c-4ca2-9f59-858958cb54b9 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 1.1193886
Jun 01 06:15:17.890931 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-27567abe-eed4-4e64-9a3e-b3c03f631151 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8087120', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099'] for subnet, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:17.896823 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:17.939862 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27567abe-eed4-4e64-9a3e-b3c03f631151 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=84c296fc-69c0-46e2-b1ed-e3edf435b759,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:17.940893 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60c8c9fb-f843-4819-96c9-ba0b65c4b8fa None None] Network 63aca663-c8c2-4fea-af09-2f342cd07692 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:15:17.946403 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-27567abe-eed4-4e64-9a3e-b3c03f631151 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:17.947377 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-27567abe-eed4-4e64-9a3e-b3c03f631151 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:17.954442 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-27567abe-eed4-4e64-9a3e-b3c03f631151 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/84c296fc-69c0-46e2-b1ed-e3edf435b759 HTTP/1.1" status: 204  len: 168 time: 0.4863937
Jun 01 06:15:17.956713 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 36544) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:18.103010 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8063377'] for network, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:18.173030 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 5a0fb2e6-0298-4b76-b4ad-e89873a54e08 no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:15:18.225193 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: 5a0fb2e6-0298-4b76-b4ad-e89873a54e08 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:15:18.225535 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 5a0fb2e6-0298-4b76-b4ad-e89873a54e08 not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:15:18.225949 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device e157eec0-3394-4fbf-8701-c05f500f506a no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:15:18.267246 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: e157eec0-3394-4fbf-8701-c05f500f506a {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:15:18.267693 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device e157eec0-3394-4fbf-8701-c05f500f506a not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:15:18.297426 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8093290', 'neutron.services.segments.db._delete_segments_for_network-8788497006300'] for network, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:18.315080 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7fe3b1c7aa60>> segment before_delete 55550000 {{(pid=92229) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:15:18.315416 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7fe3b1c7aa60>> subnet precommit_delete_associations 55550000 {{(pid=92229) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:15:18.316160 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe3b2232f40>> segment_host_mapping after_create 55550000 {{(pid=92229) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:15:18.316504 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe3b2232f40>> port after_create 55550000 {{(pid=92229) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:15:18.316824 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe3b2232f40>> port after_delete 55550000 {{(pid=92229) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:15:18.317173 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe3b2232f40>> port after_update 55550000 {{(pid=92229) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:15:18.317494 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe3b2232f40>> segment after_delete 55550000 {{(pid=92229) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:15:18.317809 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe3b2232f40>> subnet after_create 55550000 {{(pid=92229) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:15:18.318116 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe3b2232f40>> subnet after_delete 55550000 {{(pid=92229) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:15:18.318447 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fe3b2232f40>> subnet after_update 55550000 {{(pid=92229) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:15:18.387971 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fe3b1d12430>> subnet after_create 55550000 {{(pid=92229) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:15:18.388325 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fe3b1d12430>> subnet after_delete 55550000 {{(pid=92229) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:15:18.388654 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fe3b1d12430>> subnet before_create 55550000 {{(pid=92229) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:15:18.388982 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fe3b1d12430>> subnet before_update 55550000 {{(pid=92229) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 06:15:18.389349 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe3b1c7aa30>,) {'filters': {'network_id': ['6e45a0e5-f930-4b18-8f4f-1693815eb31a']}} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:18.411654 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b1c7aa30>, '1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e') {'for_net_delete': True} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:18.411979 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b1c7aa30>, '1a3b6a1c-81d8-4b0b-a773-8bb74f1b499e') {} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:18.426133 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8788497014941', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2127091'] for segment, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:18.446794 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:18.457106 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Releasing vlan 242 on physical network physnet1 to pool {{(pid=92229) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 06:15:18.457508 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2077367'] for segment, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:   from cryptography.utils import int_from_bytes
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:   from cryptography.utils import int_from_bytes
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]: Traceback (most recent call last):
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:     timer()
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:     cb(*args, **kw)
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:     return func(*args, **kwargs)
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:     self._notify()
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:     self.callback(batched_events)
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:     event.method(event)
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:     return f(self, *a, **k)
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self._get(url).json()
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self.request(url, 'GET', **kwargs)
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 06:15:18.477902 dv-cinder-793885-1-iscsi neutron-server[92229]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 06:15:18.537132 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aad105b2-36bc-4f8e-a62d-879737ecdd4a req-15503c4a-afdf-4ced-8bd2-54264f644449 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:18.538721 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-aad105b2-36bc-4f8e-a62d-879737ecdd4a req-15503c4a-afdf-4ced-8bd2-54264f644449 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=6d41e731-342f-457d-82c5-09f702557793 HTTP/1.1" status: 200  len: 946 time: 0.2913899
Jun 01 06:15:18.594568 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8093283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-745674'] for network, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:18.606162 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ccd7b979-fcaf-4601-a656-49c9a65508c3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:18.622573 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-aad105b2-36bc-4f8e-a62d-879737ecdd4a req-e4370c0a-e212-46ec-a54a-3bac73d3a28a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0706508
Jun 01 06:15:18.626569 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:18.632582 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Pushing event deleted for resources: {'Network': ['ID=6e45a0e5-f930-4b18-8f4f-1693815eb31a,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:18.639445 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:18.647635 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-60f6b2f4-3d08-4ffb-87e8-15edddcff09e admin admin] 10.222.0.25 "DELETE /v2.0/networks/6e45a0e5-f930-4b18-8f4f-1693815eb31a HTTP/1.1" status: 204  len: 168 time: 0.6894338
Jun 01 06:15:18.828662 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 36558) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:18.881228 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-a3b9c020-53ba-4382-8efb-8124b0bbea5d admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=8f1cf739e243401eb5da7ee705e856de&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0513330
Jun 01 06:15:18.884166 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 36562) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:18.944120 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-705352b6-febb-4ece-927b-13c325bd002e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:18.969606 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-705352b6-febb-4ece-927b-13c325bd002e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:19.025701 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-705352b6-febb-4ece-927b-13c325bd002e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:19.029699 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:19.042622 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-705352b6-febb-4ece-927b-13c325bd002e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d0ab3203-d9c6-4a65-bc8f-4630202ec93a,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:19.045782 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-705352b6-febb-4ece-927b-13c325bd002e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:19.058004 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-705352b6-febb-4ece-927b-13c325bd002e admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:19.061832 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-705352b6-febb-4ece-927b-13c325bd002e admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/d0ab3203-d9c6-4a65-bc8f-4630202ec93a HTTP/1.1" status: 204  len: 168 time: 0.1742070
Jun 01 06:15:19.991257 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93edd7a4-f6c4-4113-92a0-7281a2de9dd6 req-f666f65f-299b-4e35-9058-b8e5fbdfdda6 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:19.992817 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-93edd7a4-f6c4-4113-92a0-7281a2de9dd6 req-f666f65f-299b-4e35-9058-b8e5fbdfdda6 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=6d41e731-342f-457d-82c5-09f702557793 HTTP/1.1" status: 200  len: 946 time: 0.0871906
Jun 01 06:15:20.043987 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-93edd7a4-f6c4-4113-92a0-7281a2de9dd6 req-9448ca1b-7cda-46fa-8c00-99d851c52d1d tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0449030
Jun 01 06:15:21.237812 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cff167d8-f5ce-4ae1-a062-2815968f5896 req-48cd896a-02be-4ab6-9fff-c860eec17708 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:21.239264 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cff167d8-f5ce-4ae1-a062-2815968f5896 req-48cd896a-02be-4ab6-9fff-c860eec17708 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=6d41e731-342f-457d-82c5-09f702557793 HTTP/1.1" status: 200  len: 946 time: 0.0803263
Jun 01 06:15:21.286234 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cff167d8-f5ce-4ae1-a062-2815968f5896 req-62b73a93-c5cb-456a-8a13-c2fec6aaf85c tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/security-groups?id=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0410798
Jun 01 06:15:21.555078 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b487676-3a13-4cac-a72a-f909258a209d req-65a0496e-0c8e-47be-be42-da765433c93c tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:21.556545 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1b487676-3a13-4cac-a72a-f909258a209d req-65a0496e-0c8e-47be-be42-da765433c93c tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.48 "GET /v2.0/ports?device_id=6d41e731-342f-457d-82c5-09f702557793 HTTP/1.1" status: 200  len: 946 time: 0.0838912
Jun 01 06:15:21.704515 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-1b487676-3a13-4cac-a72a-f909258a209d req-e44336f1-4f32-4352-9f4a-30c9311db003 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Deleting port b52209fd-778b-498b-aa98-e818d0fee891 {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:15:21.704515 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-1b487676-3a13-4cac-a72a-f909258a209d req-e44336f1-4f32-4352-9f4a-30c9311db003 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:21.934784 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-1b487676-3a13-4cac-a72a-f909258a209d req-e44336f1-4f32-4352-9f4a-30c9311db003 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] For port b52209fd-778b-498b-aa98-e818d0fee891, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=b52209fd-778b-498b-aa98-e818d0fee891,segment=NetworkSegment(c333deab-77ad-4250-916e-537423452613),segment_id=c333deab-77ad-4250-916e-537423452613)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:15:21.935045 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-1b487676-3a13-4cac-a72a-f909258a209d req-e44336f1-4f32-4352-9f4a-30c9311db003 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:22.072325 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-1b487676-3a13-4cac-a72a-f909258a209d req-e44336f1-4f32-4352-9f4a-30c9311db003 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Calling delete_port for b52209fd-778b-498b-aa98-e818d0fee891 owned by compute:nova {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:15:22.192040 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-1b487676-3a13-4cac-a72a-f909258a209d req-e44336f1-4f32-4352-9f4a-30c9311db003 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:22.198150 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ceb82961-3485-4405-8665-22daae88544a tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:22.247657 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e44336f1-4f32-4352-9f4a-30c9311db003 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Pushing event deleted for resources: {'Port': ['ID=b52209fd-778b-498b-aa98-e818d0fee891,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:22.250944 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-e44336f1-4f32-4352-9f4a-30c9311db003 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:22.330365 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-1b487676-3a13-4cac-a72a-f909258a209d req-e44336f1-4f32-4352-9f4a-30c9311db003 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] No DVR routers for this DVR port b52209fd-778b-498b-aa98-e818d0fee891 on host hv-cinder-79388 {{(pid=92229) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:15:22.332927 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-1b487676-3a13-4cac-a72a-f909258a209d req-e44336f1-4f32-4352-9f4a-30c9311db003 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:22.335804 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6d41e731-342f-457d-82c5-09f702557793', 'name': 'network-vif-deleted', 'tag': 'b52209fd-778b-498b-aa98-e818d0fee891'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:15:22.338210 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2306ea8e-cf22-4324-b4a2-dc231d13191c" -d '{"events": [{"server_uuid": "6d41e731-342f-457d-82c5-09f702557793", "name": "network-vif-deleted", "tag": "b52209fd-778b-498b-aa98-e818d0fee891"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:15:22.359395 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1b487676-3a13-4cac-a72a-f909258a209d req-e44336f1-4f32-4352-9f4a-30c9311db003 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.48 "DELETE /v2.0/ports/b52209fd-778b-498b-aa98-e818d0fee891 HTTP/1.1" status: 204  len: 173 time: 0.7969377
Jun 01 06:15:22.390380 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:15:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0390856c-ca38-4b10-b318-3a1b31bae762 x-openstack-request-id: req-0390856c-ca38-4b10-b318-3a1b31bae762 {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:15:22.390944 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6d41e731-342f-457d-82c5-09f702557793", "name": "network-vif-deleted", "tag": "b52209fd-778b-498b-aa98-e818d0fee891", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:15:22.391379 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-0390856c-ca38-4b10-b318-3a1b31bae762 {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:15:22.392004 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6d41e731-342f-457d-82c5-09f702557793', 'name': 'network-vif-deleted', 'tag': 'b52209fd-778b-498b-aa98-e818d0fee891', 'status': 'completed', 'code': 200}
Jun 01 06:15:22.447438 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-5039fbec-5719-4083-ba01-60c26fb4055c req-021e99dd-2d73-4641-8de0-0b215097fa11 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Synchronizing usage tracker for tenant:dd97906039e7487cbb91b21981aa107c on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:15:22.469178 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-5039fbec-5719-4083-ba01-60c26fb4055c req-021e99dd-2d73-4641-8de0-0b215097fa11 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Unset dirty status for tenant:dd97906039e7487cbb91b21981aa107c on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:15:22.471193 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5039fbec-5719-4083-ba01-60c26fb4055c req-021e99dd-2d73-4641-8de0-0b215097fa11 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] 10.222.0.25 "GET /v2.0/ports?device_id=6d41e731-342f-457d-82c5-09f702557793 HTTP/1.1" status: 200  len: 210 time: 0.0700541
Jun 01 06:15:23.972690 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 36710) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:24.103014 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-068e4bd8-e0f4-472d-90ab-a92506dd202f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:24.120235 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-068e4bd8-e0f4-472d-90ab-a92506dd202f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:24.124097 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-068e4bd8-e0f4-472d-90ab-a92506dd202f admin admin] Usage tracker for resource:security_group_rule and tenant:7317a52cf05449a883f856b475aae0af is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:24.126897 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-068e4bd8-e0f4-472d-90ab-a92506dd202f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:24.132648 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-068e4bd8-e0f4-472d-90ab-a92506dd202f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:24.170556 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device b52209fd-778b-498b-aa98-e818d0fee891 no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:15:24.209071 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] No Port match for: b52209fd-778b-498b-aa98-e818d0fee891 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:15:24.209424 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device b52209fd-778b-498b-aa98-e818d0fee891 not bound to the agent host hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:15:24.228049 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-068e4bd8-e0f4-472d-90ab-a92506dd202f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:24.232888 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-068e4bd8-e0f4-472d-90ab-a92506dd202f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:24.239803 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:24.281347 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-068e4bd8-e0f4-472d-90ab-a92506dd202f admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=7317a52cf05449a883f856b475aae0af&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3075542
Jun 01 06:15:24.282243 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-068e4bd8-e0f4-472d-90ab-a92506dd202f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=680f6871-22ef-45d0-ab1c-a62ae32a5fef,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:24.284064 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 36722) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:24.285363 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-068e4bd8-e0f4-472d-90ab-a92506dd202f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:24.363272 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-5c05df70-63bc-4c3f-bde4-d32b448c906f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:24.395139 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-5c05df70-63bc-4c3f-bde4-d32b448c906f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:24.460042 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-5c05df70-63bc-4c3f-bde4-d32b448c906f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:24.467731 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e0eb4cae-019a-454b-8146-e537fed9657e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:24.476087 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c05df70-63bc-4c3f-bde4-d32b448c906f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=680f6871-22ef-45d0-ab1c-a62ae32a5fef,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:24.478532 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-5c05df70-63bc-4c3f-bde4-d32b448c906f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:24.492404 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-5c05df70-63bc-4c3f-bde4-d32b448c906f admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:24.496360 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-5c05df70-63bc-4c3f-bde4-d32b448c906f admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/680f6871-22ef-45d0-ab1c-a62ae32a5fef HTTP/1.1" status: 204  len: 168 time: 0.2111292
Jun 01 06:15:24.826387 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 36752) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:24.850520 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-dd1cce0e-0cab-4928-a3cd-c22f6a8e7b8e admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:24.873812 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-dd1cce0e-0cab-4928-a3cd-c22f6a8e7b8e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:24.883030 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-dd1cce0e-0cab-4928-a3cd-c22f6a8e7b8e admin admin] Usage tracker for resource:security_group_rule and tenant:74a954d479ee4feb9ea34dc09089a3b3 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:24.887660 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-dd1cce0e-0cab-4928-a3cd-c22f6a8e7b8e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:24.893693 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-dd1cce0e-0cab-4928-a3cd-c22f6a8e7b8e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:24.996708 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-dd1cce0e-0cab-4928-a3cd-c22f6a8e7b8e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:25.001007 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-dd1cce0e-0cab-4928-a3cd-c22f6a8e7b8e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:25.009381 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-dd730d8d-70c6-4461-899e-e2491b29882c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:25.050138 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-dd1cce0e-0cab-4928-a3cd-c22f6a8e7b8e admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=74a954d479ee4feb9ea34dc09089a3b3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2225013
Jun 01 06:15:25.051390 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd1cce0e-0cab-4928-a3cd-c22f6a8e7b8e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=98cdc53c-b15d-4c1b-b576-f7a996ffc0ce,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:25.052883 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 36770) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:25.054608 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-dd1cce0e-0cab-4928-a3cd-c22f6a8e7b8e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:25.116521 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-cea063af-f4e2-4c9a-ab1b-962e94d5e67c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:25.142422 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-cea063af-f4e2-4c9a-ab1b-962e94d5e67c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:25.194577 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-cea063af-f4e2-4c9a-ab1b-962e94d5e67c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:25.199013 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-210b961d-97f2-4a69-9dc3-e5f3e05d662c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:25.211875 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cea063af-f4e2-4c9a-ab1b-962e94d5e67c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=98cdc53c-b15d-4c1b-b576-f7a996ffc0ce,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:25.214980 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-cea063af-f4e2-4c9a-ab1b-962e94d5e67c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:25.222628 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-cea063af-f4e2-4c9a-ab1b-962e94d5e67c admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:25.223724 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-cea063af-f4e2-4c9a-ab1b-962e94d5e67c admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/98cdc53c-b15d-4c1b-b576-f7a996ffc0ce HTTP/1.1" status: 204  len: 168 time: 0.1698418
Jun 01 06:15:28.555850 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 36924) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:28.676529 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-263821f5-27ee-4e64-822d-c322c3e6fc34 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:28.691888 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-263821f5-27ee-4e64-822d-c322c3e6fc34 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:28.695633 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-263821f5-27ee-4e64-822d-c322c3e6fc34 admin admin] Usage tracker for resource:security_group_rule and tenant:65e4a5ca3b1e4a8f850623f533883cd9 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:28.698622 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-263821f5-27ee-4e64-822d-c322c3e6fc34 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:28.704278 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-263821f5-27ee-4e64-822d-c322c3e6fc34 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:28.785422 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-263821f5-27ee-4e64-822d-c322c3e6fc34 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:28.789013 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-263821f5-27ee-4e64-822d-c322c3e6fc34 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:28.798158 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-64fceaab-5086-41ec-8a6b-c476dda1fbb9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:28.849651 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-263821f5-27ee-4e64-822d-c322c3e6fc34 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=65e4a5ca3b1e4a8f850623f533883cd9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2925117
Jun 01 06:15:28.850652 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-263821f5-27ee-4e64-822d-c322c3e6fc34 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=028bfb1d-0084-425d-8d83-ee80116b6590,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:28.852075 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 36932) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:28.860457 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263821f5-27ee-4e64-822d-c322c3e6fc34 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:28.860827 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263821f5-27ee-4e64-822d-c322c3e6fc34 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:28.861183 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263821f5-27ee-4e64-822d-c322c3e6fc34 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:28.861536 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263821f5-27ee-4e64-822d-c322c3e6fc34 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:28.861883 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263821f5-27ee-4e64-822d-c322c3e6fc34 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:28.862229 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263821f5-27ee-4e64-822d-c322c3e6fc34 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:28.862571 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263821f5-27ee-4e64-822d-c322c3e6fc34 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:28.862916 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263821f5-27ee-4e64-822d-c322c3e6fc34 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:28.863257 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263821f5-27ee-4e64-822d-c322c3e6fc34 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:28.863597 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263821f5-27ee-4e64-822d-c322c3e6fc34 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:28.863971 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263821f5-27ee-4e64-822d-c322c3e6fc34 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:28.864313 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-263821f5-27ee-4e64-822d-c322c3e6fc34 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:28.870633 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-263821f5-27ee-4e64-822d-c322c3e6fc34 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:28.933141 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9e1dc03f-bdd8-48cf-a8dd-50d36979a062 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:29.055436 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9e1dc03f-bdd8-48cf-a8dd-50d36979a062 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:29.113079 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9e1dc03f-bdd8-48cf-a8dd-50d36979a062 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:29.118016 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-00d83b41-16ba-4158-a85f-548046345f08 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:29.130373 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e1dc03f-bdd8-48cf-a8dd-50d36979a062 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=028bfb1d-0084-425d-8d83-ee80116b6590,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:29.134039 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-9e1dc03f-bdd8-48cf-a8dd-50d36979a062 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:29.140424 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9e1dc03f-bdd8-48cf-a8dd-50d36979a062 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:29.144014 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-9e1dc03f-bdd8-48cf-a8dd-50d36979a062 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/028bfb1d-0084-425d-8d83-ee80116b6590 HTTP/1.1" status: 204  len: 168 time: 0.2879355
Jun 01 06:15:29.473415 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 36964) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:29.517934 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e92b3783-6719-4567-bd81-ab2f85ea8df7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:29.536404 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e92b3783-6719-4567-bd81-ab2f85ea8df7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:29.541712 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e92b3783-6719-4567-bd81-ab2f85ea8df7 admin admin] Usage tracker for resource:security_group_rule and tenant:1ad2935b28f24cf49aa7a57fcc7f8fe7 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:29.545331 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e92b3783-6719-4567-bd81-ab2f85ea8df7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:29.553069 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e92b3783-6719-4567-bd81-ab2f85ea8df7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:29.671675 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e92b3783-6719-4567-bd81-ab2f85ea8df7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:29.677607 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e92b3783-6719-4567-bd81-ab2f85ea8df7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:29.687151 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-02682992-69fa-4c03-bdab-910390ddd1d3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:29.732786 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-e92b3783-6719-4567-bd81-ab2f85ea8df7 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=1ad2935b28f24cf49aa7a57fcc7f8fe7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2581973
Jun 01 06:15:29.732996 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 36974) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:29.734845 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e92b3783-6719-4567-bd81-ab2f85ea8df7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4f75b5ea-ab94-4215-912a-1970b4b33cec,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:29.742869 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e92b3783-6719-4567-bd81-ab2f85ea8df7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:29.743301 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e92b3783-6719-4567-bd81-ab2f85ea8df7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:29.743668 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e92b3783-6719-4567-bd81-ab2f85ea8df7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:29.744066 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e92b3783-6719-4567-bd81-ab2f85ea8df7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:29.744481 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e92b3783-6719-4567-bd81-ab2f85ea8df7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:29.744899 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e92b3783-6719-4567-bd81-ab2f85ea8df7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:29.745242 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e92b3783-6719-4567-bd81-ab2f85ea8df7 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:29.745629 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e92b3783-6719-4567-bd81-ab2f85ea8df7 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:29.745935 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e92b3783-6719-4567-bd81-ab2f85ea8df7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:29.746277 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e92b3783-6719-4567-bd81-ab2f85ea8df7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:29.746619 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e92b3783-6719-4567-bd81-ab2f85ea8df7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:29.746953 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e92b3783-6719-4567-bd81-ab2f85ea8df7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:29.751298 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e92b3783-6719-4567-bd81-ab2f85ea8df7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:29.830880 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d821b9c5-4ea0-4701-a7ae-963763c53e7f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:29.869509 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d821b9c5-4ea0-4701-a7ae-963763c53e7f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:29.944298 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d821b9c5-4ea0-4701-a7ae-963763c53e7f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:29.950459 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-068e4bd8-e0f4-472d-90ab-a92506dd202f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:29.967141 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d821b9c5-4ea0-4701-a7ae-963763c53e7f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4f75b5ea-ab94-4215-912a-1970b4b33cec,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:29.971360 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-d821b9c5-4ea0-4701-a7ae-963763c53e7f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:29.973914 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d821b9c5-4ea0-4701-a7ae-963763c53e7f admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:29.988992 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-d821b9c5-4ea0-4701-a7ae-963763c53e7f admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/4f75b5ea-ab94-4215-912a-1970b4b33cec HTTP/1.1" status: 204  len: 168 time: 0.2436788
Jun 01 06:15:37.541707 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 37152) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:37.726022 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-cf7ca0ed-8de2-499f-8ed3-df9b0feaec52 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:37.746694 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-cf7ca0ed-8de2-499f-8ed3-df9b0feaec52 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:37.751467 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-cf7ca0ed-8de2-499f-8ed3-df9b0feaec52 admin admin] Usage tracker for resource:security_group_rule and tenant:1dd9d4a46b784d90adcbf1cafdedc21f is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:37.754443 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-cf7ca0ed-8de2-499f-8ed3-df9b0feaec52 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:37.761375 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-cf7ca0ed-8de2-499f-8ed3-df9b0feaec52 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:37.866017 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-cf7ca0ed-8de2-499f-8ed3-df9b0feaec52 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:37.871308 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-cf7ca0ed-8de2-499f-8ed3-df9b0feaec52 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:37.878900 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-cea063af-f4e2-4c9a-ab1b-962e94d5e67c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:37.909196 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf7ca0ed-8de2-499f-8ed3-df9b0feaec52 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=43e0e152-ddc5-451a-ae56-952d98d2ff41,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:37.912325 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-cf7ca0ed-8de2-499f-8ed3-df9b0feaec52 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:37.933561 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-cf7ca0ed-8de2-499f-8ed3-df9b0feaec52 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=1dd9d4a46b784d90adcbf1cafdedc21f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3881962
Jun 01 06:15:37.933870 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37158) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:38.016982 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8fe403ac-c6c5-41b4-b608-5cc6e3c2ed19 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:38.047900 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8fe403ac-c6c5-41b4-b608-5cc6e3c2ed19 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:38.104245 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8fe403ac-c6c5-41b4-b608-5cc6e3c2ed19 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:38.109461 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-b833266a-9214-4b07-b0db-1d31ea6a1d9a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:38.124846 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fe403ac-c6c5-41b4-b608-5cc6e3c2ed19 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=43e0e152-ddc5-451a-ae56-952d98d2ff41,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:38.127646 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-8fe403ac-c6c5-41b4-b608-5cc6e3c2ed19 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:38.137977 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8fe403ac-c6c5-41b4-b608-5cc6e3c2ed19 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:38.149382 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-8fe403ac-c6c5-41b4-b608-5cc6e3c2ed19 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/43e0e152-ddc5-451a-ae56-952d98d2ff41 HTTP/1.1" status: 204  len: 168 time: 0.2142205
Jun 01 06:15:38.342041 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-a8bc31bc-c68d-456a-ad07-4a8c9acdad7f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:38.552380 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37178) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:38.592907 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e85143ad-a13b-4a89-948c-362e5c6c0b00 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:38.608105 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e85143ad-a13b-4a89-948c-362e5c6c0b00 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:38.612017 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e85143ad-a13b-4a89-948c-362e5c6c0b00 admin admin] Usage tracker for resource:security_group_rule and tenant:a2635df81c614a558106a5704b128311 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:38.615007 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e85143ad-a13b-4a89-948c-362e5c6c0b00 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:38.622346 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e85143ad-a13b-4a89-948c-362e5c6c0b00 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:38.649556 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 37190) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:38.713826 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_v2 [None req-dd2c46e4-e92c-4352-8fcf-289a32964afe admin admin] Deleting subnet 0d90443d-758c-4b5b-b23f-0afae18a4b8b {{(pid=92229) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 06:15:38.717344 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-dd2c46e4-e92c-4352-8fcf-289a32964afe admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:38.725353 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e85143ad-a13b-4a89-948c-362e5c6c0b00 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:38.734728 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e85143ad-a13b-4a89-948c-362e5c6c0b00 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:38.745936 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-221edb6f-3243-4254-a7cd-44774403146a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:38.779136 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-dd2c46e4-e92c-4352-8fcf-289a32964afe admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2127096'] for subnet, precommit_delete_associations {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:38.796598 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e85143ad-a13b-4a89-948c-362e5c6c0b00 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=22bb8e19-cfa1-44dc-be5f-114b2fe79e45,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:38.815338 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 37194) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:38.816392 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-e85143ad-a13b-4a89-948c-362e5c6c0b00 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=a2635df81c614a558106a5704b128311&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2624767
Jun 01 06:15:38.817606 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e85143ad-a13b-4a89-948c-362e5c6c0b00 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:38.873515 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-dd2c46e4-e92c-4352-8fcf-289a32964afe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8086245'] for subnet, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:38.946691 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-85b6cf5f-e116-4f87-b060-292df6468375 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:39.040947 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-85b6cf5f-e116-4f87-b060-292df6468375 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:39.185278 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-85b6cf5f-e116-4f87-b060-292df6468375 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:39.190855 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-3922dfbd-96e5-428e-9012-da64a5c61554 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:39.211983 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85b6cf5f-e116-4f87-b060-292df6468375 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=22bb8e19-cfa1-44dc-be5f-114b2fe79e45,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:39.216598 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-85b6cf5f-e116-4f87-b060-292df6468375 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:39.260615 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-85b6cf5f-e116-4f87-b060-292df6468375 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:39.262662 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-85b6cf5f-e116-4f87-b060-292df6468375 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/22bb8e19-cfa1-44dc-be5f-114b2fe79e45 HTTP/1.1" status: 204  len: 168 time: 0.4455273
Jun 01 06:15:39.282617 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-dd2c46e4-e92c-4352-8fcf-289a32964afe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8087120', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1981457', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2134750'] for subnet, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:39.286926 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-27567abe-eed4-4e64-9a3e-b3c03f631151 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:39.328952 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd2c46e4-e92c-4352-8fcf-289a32964afe admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0d90443d-758c-4b5b-b23f-0afae18a4b8b,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:39.332125 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-dd2c46e4-e92c-4352-8fcf-289a32964afe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:39.333125 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-dd2c46e4-e92c-4352-8fcf-289a32964afe admin admin] Notify callbacks [] for subnet, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:39.340933 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-dd2c46e4-e92c-4352-8fcf-289a32964afe admin admin] 10.222.0.25 "DELETE /v2.0/subnets/0d90443d-758c-4b5b-b23f-0afae18a4b8b HTTP/1.1" status: 204  len: 168 time: 0.6901708
Jun 01 06:15:39.343849 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37200) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:39.524709 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-380c34f0-4d30-4957-a7f5-24e6c9e00c2b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8063377'] for network, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:39.683636 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-380c34f0-4d30-4957-a7f5-24e6c9e00c2b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8093290', 'neutron.services.segments.db._delete_segments_for_network-8788497006300'] for network, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:39.700442 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-380c34f0-4d30-4957-a7f5-24e6c9e00c2b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe3b171e790>,) {'filters': {'network_id': ['bae00e81-19b5-4fe7-a773-a08e675104fd']}} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:39.716616 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-380c34f0-4d30-4957-a7f5-24e6c9e00c2b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b171e790>, '92215424-bdde-4f41-a802-40025f30d832') {'for_net_delete': True} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:39.717232 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-380c34f0-4d30-4957-a7f5-24e6c9e00c2b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b171e790>, '92215424-bdde-4f41-a802-40025f30d832') {} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:39.734500 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-380c34f0-4d30-4957-a7f5-24e6c9e00c2b admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8788497014941', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2178892'] for segment, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:39.755950 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-380c34f0-4d30-4957-a7f5-24e6c9e00c2b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:39.769711 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-380c34f0-4d30-4957-a7f5-24e6c9e00c2b admin admin] Releasing vlan 203 on physical network physnet1 to pool {{(pid=92230) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 06:15:39.771040 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-380c34f0-4d30-4957-a7f5-24e6c9e00c2b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2416152'] for segment, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]: Traceback (most recent call last):
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:     timer()
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:     cb(*args, **kw)
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:     return func(*args, **kwargs)
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:     self._notify()
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:     self.callback(batched_events)
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:     event.method(event)
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:     return f(self, *a, **k)
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self._get(url).json()
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self.request(url, 'GET', **kwargs)
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 06:15:39.788743 dv-cinder-793885-1-iscsi neutron-server[92230]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 06:15:39.899821 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-380c34f0-4d30-4957-a7f5-24e6c9e00c2b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8093283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-745674'] for network, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:39.906186 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e217ab0a-e1e6-45db-a6a9-21718dcb2b5c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:39.942489 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-380c34f0-4d30-4957-a7f5-24e6c9e00c2b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:39.947827 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-380c34f0-4d30-4957-a7f5-24e6c9e00c2b admin admin] Pushing event deleted for resources: {'Network': ['ID=bae00e81-19b5-4fe7-a773-a08e675104fd,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:39.955106 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-380c34f0-4d30-4957-a7f5-24e6c9e00c2b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:39.959620 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-380c34f0-4d30-4957-a7f5-24e6c9e00c2b admin admin] 10.222.0.25 "DELETE /v2.0/networks/bae00e81-19b5-4fe7-a773-a08e675104fd HTTP/1.1" status: 204  len: 168 time: 0.6141260
Jun 01 06:15:39.961230 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37218) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:40.029902 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_v2 [None req-01d68eb7-0531-4dce-89b7-0877788982c3 admin admin] Deleting subnet 1c45f0c4-a67f-4949-992d-a757835e7a77 {{(pid=92230) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 06:15:40.033485 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-01d68eb7-0531-4dce-89b7-0877788982c3 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:40.095876 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-01d68eb7-0531-4dce-89b7-0877788982c3 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2178887'] for subnet, precommit_delete_associations {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:40.157477 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-01d68eb7-0531-4dce-89b7-0877788982c3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8086245'] for subnet, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:40.479021 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-01d68eb7-0531-4dce-89b7-0877788982c3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8087120', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2445502', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1981527'] for subnet, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:40.489471 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:40.529488 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01d68eb7-0531-4dce-89b7-0877788982c3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1c45f0c4-a67f-4949-992d-a757835e7a77,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:40.534828 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-01d68eb7-0531-4dce-89b7-0877788982c3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:40.536064 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-01d68eb7-0531-4dce-89b7-0877788982c3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:40.548064 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 37238) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:40.549244 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-01d68eb7-0531-4dce-89b7-0877788982c3 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/1c45f0c4-a67f-4949-992d-a757835e7a77 HTTP/1.1" status: 204  len: 168 time: 0.5869410
Jun 01 06:15:40.718632 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-9dd4e294-7df3-4ef6-b757-524ca636a537 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8063377'] for network, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:40.957254 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-9dd4e294-7df3-4ef6-b757-524ca636a537 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8093290', 'neutron.services.segments.db._delete_segments_for_network-8788497006300'] for network, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:40.972393 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-9dd4e294-7df3-4ef6-b757-524ca636a537 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe3b1111280>,) {'filters': {'network_id': ['63aca663-c8c2-4fea-af09-2f342cd07692']}} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:40.985843 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-9dd4e294-7df3-4ef6-b757-524ca636a537 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b1111280>, 'c881206a-23ee-4c3a-a184-5698c6d130b6') {'for_net_delete': True} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:40.986401 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-9dd4e294-7df3-4ef6-b757-524ca636a537 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b1111280>, 'c881206a-23ee-4c3a-a184-5698c6d130b6') {} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:41.002873 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-9dd4e294-7df3-4ef6-b757-524ca636a537 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8788497014941', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2127091'] for segment, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:41.021348 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-9dd4e294-7df3-4ef6-b757-524ca636a537 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:41.032363 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9dd4e294-7df3-4ef6-b757-524ca636a537 admin admin] Releasing vlan 223 on physical network physnet1 to pool {{(pid=92229) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 06:15:41.032778 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-9dd4e294-7df3-4ef6-b757-524ca636a537 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2077367'] for segment, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]: Traceback (most recent call last):
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:     timer()
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:     cb(*args, **kw)
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:     return func(*args, **kwargs)
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:     self._notify()
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:     self.callback(batched_events)
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:     event.method(event)
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:     return f(self, *a, **k)
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self._get(url).json()
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self.request(url, 'GET', **kwargs)
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 06:15:41.051692 dv-cinder-793885-1-iscsi neutron-server[92229]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 06:15:41.148204 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-9dd4e294-7df3-4ef6-b757-524ca636a537 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8093283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-745674'] for network, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:41.161060 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-9dd4e294-7df3-4ef6-b757-524ca636a537 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:41.164365 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-e1480ee5-074e-4a0f-851b-7459c1d1062a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:41.187152 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dd4e294-7df3-4ef6-b757-524ca636a537 admin admin] Pushing event deleted for resources: {'Network': ['ID=63aca663-c8c2-4fea-af09-2f342cd07692,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:41.192669 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-9dd4e294-7df3-4ef6-b757-524ca636a537 admin admin] 10.222.0.25 "DELETE /v2.0/networks/63aca663-c8c2-4fea-af09-2f342cd07692 HTTP/1.1" status: 204  len: 168 time: 0.6433804
Jun 01 06:15:41.194661 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-9dd4e294-7df3-4ef6-b757-524ca636a537 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:41.230740 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:41.409887 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 37266) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:41.496322 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37270) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:41.496856 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-77992408-f5c1-4340-ac20-645bdd0417ee admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=38cfd48899ed4a7e885330603ad8b8d1&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0853345
Jun 01 06:15:41.585588 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0a374d42-6532-4db2-9632-7b9815936fe8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:41.615626 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0a374d42-6532-4db2-9632-7b9815936fe8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:41.688171 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0a374d42-6532-4db2-9632-7b9815936fe8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:41.695473 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-fe6e2b83-f91b-418e-a105-43834a6bd355 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:41.719192 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a374d42-6532-4db2-9632-7b9815936fe8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=90d2c0d8-2deb-40fa-a61d-e1397f11a27c,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:41.722418 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-0a374d42-6532-4db2-9632-7b9815936fe8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:41.724434 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0a374d42-6532-4db2-9632-7b9815936fe8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:41.726018 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-0a374d42-6532-4db2-9632-7b9815936fe8 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/90d2c0d8-2deb-40fa-a61d-e1397f11a27c HTTP/1.1" status: 204  len: 168 time: 0.2284727
Jun 01 06:15:42.269107 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37290) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:42.342716 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-ab430b32-8bf1-4c88-9ca3-36829f592d21 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:42.357592 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-6bd84204-3905-47c6-86a1-5c7806edc82e admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=8656d220516c4779a9293fb82708033e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0859249
Jun 01 06:15:42.360120 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 37296) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:42.429026 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d09b9ae4-f399-453a-832a-a7655a96e58d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:42.470355 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d09b9ae4-f399-453a-832a-a7655a96e58d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:42.538002 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d09b9ae4-f399-453a-832a-a7655a96e58d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:42.543632 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-d821b9c5-4ea0-4701-a7ae-963763c53e7f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:42.557212 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d09b9ae4-f399-453a-832a-a7655a96e58d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bca41759-2a83-4b36-b450-633ce6b1dad6,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:42.560813 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-d09b9ae4-f399-453a-832a-a7655a96e58d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:42.576821 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d09b9ae4-f399-453a-832a-a7655a96e58d admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:42.578016 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-d09b9ae4-f399-453a-832a-a7655a96e58d admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/bca41759-2a83-4b36-b450-633ce6b1dad6 HTTP/1.1" status: 204  len: 168 time: 0.2166209
Jun 01 06:15:43.269841 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:45.389636 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:45.989295 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:46.289241 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e735201d-8fe8-461f-9768-838881b1ec8d req-e9133bd6-d555-4ada-9f2e-02c04005ebe9 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:46.292349 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e735201d-8fe8-461f-9768-838881b1ec8d req-e9133bd6-d555-4ada-9f2e-02c04005ebe9 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 946 time: 0.1285045
Jun 01 06:15:46.367509 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e735201d-8fe8-461f-9768-838881b1ec8d req-6d39d6d9-02a5-4b79-9e85-ae3470c2350b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0695438
Jun 01 06:15:47.589084 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eaa2373-b629-4b25-a530-169b2bf23432 req-6281e2c4-bebc-4474-a222-56201cd02524 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:47.590501 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8eaa2373-b629-4b25-a530-169b2bf23432 req-6281e2c4-bebc-4474-a222-56201cd02524 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 946 time: 0.0862241
Jun 01 06:15:47.637016 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8eaa2373-b629-4b25-a530-169b2bf23432 req-6ae6533f-f763-45f9-83c7-6dbc8d8811ee tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=d244799f-12ae-4ce0-9252-891377721dbc&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0396752
Jun 01 06:15:47.855762 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea265add-8801-43fe-a81b-82825d9d5e84 req-0754d455-7401-4fdc-a802-88e8a654a5f5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:47.857227 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ea265add-8801-43fe-a81b-82825d9d5e84 req-0754d455-7401-4fdc-a802-88e8a654a5f5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.48 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 946 time: 0.0817523
Jun 01 06:15:47.999492 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-ea265add-8801-43fe-a81b-82825d9d5e84 req-67845aaf-87b7-46a4-85a9-9b5e39d29a4c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Deleting port 826848c6-a93a-4712-82dd-39e403bcb79e {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:15:47.999868 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-ea265add-8801-43fe-a81b-82825d9d5e84 req-67845aaf-87b7-46a4-85a9-9b5e39d29a4c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:48.139846 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-ea265add-8801-43fe-a81b-82825d9d5e84 req-67845aaf-87b7-46a4-85a9-9b5e39d29a4c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] For port 826848c6-a93a-4712-82dd-39e403bcb79e, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=826848c6-a93a-4712-82dd-39e403bcb79e,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:15:48.140260 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-ea265add-8801-43fe-a81b-82825d9d5e84 req-67845aaf-87b7-46a4-85a9-9b5e39d29a4c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:48.453553 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37514) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:48.457330 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-ea265add-8801-43fe-a81b-82825d9d5e84 req-67845aaf-87b7-46a4-85a9-9b5e39d29a4c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:48.457638 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-ea265add-8801-43fe-a81b-82825d9d5e84 req-67845aaf-87b7-46a4-85a9-9b5e39d29a4c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-745720'] for floatingip, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:48.458038 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.db.l3_db [req-ea265add-8801-43fe-a81b-82825d9d5e84 req-67845aaf-87b7-46a4-85a9-9b5e39d29a4c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Floating IP 8639dc42-b15e-4dfb-b648-ca0a9c38fd05 disassociated. External IP: 172.27.2.242, port: 826848c6-a93a-4712-82dd-39e403bcb79e.
Jun 01 06:15:48.458487 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-ea265add-8801-43fe-a81b-82825d9d5e84 req-67845aaf-87b7-46a4-85a9-9b5e39d29a4c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Calling delete_port for 826848c6-a93a-4712-82dd-39e403bcb79e owned by compute:nova {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:15:48.500029 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37524) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:48.620359 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-ea265add-8801-43fe-a81b-82825d9d5e84 req-67845aaf-87b7-46a4-85a9-9b5e39d29a4c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:48.636579 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-4b6b1d53-ecac-4929-b7e2-27d87649b603 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:48.653389 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2784bfcb-7e2d-4678-b43b-fed08c52d2d2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:48.673872 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-2784bfcb-7e2d-4678-b43b-fed08c52d2d2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:48.691719 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-2784bfcb-7e2d-4678-b43b-fed08c52d2d2 admin admin] Usage tracker for resource:security_group_rule and tenant:d5ccc33320a0421784679df83360633e is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:48.695501 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-2784bfcb-7e2d-4678-b43b-fed08c52d2d2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:48.704308 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-2784bfcb-7e2d-4678-b43b-fed08c52d2d2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:48.716931 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:15:48.727605 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-16e39396-d28e-40f1-ab53-fd37d7ae7e11 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:48.729937 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67845aaf-87b7-46a4-85a9-9b5e39d29a4c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Pushing event deleted for resources: {'Port': ['ID=826848c6-a93a-4712-82dd-39e403bcb79e,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:48.777693 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-16e39396-d28e-40f1-ab53-fd37d7ae7e11 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:48.781793 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-16e39396-d28e-40f1-ab53-fd37d7ae7e11 admin admin] Usage tracker for resource:security_group_rule and tenant:f45e49f4223d480caa56bf039d9d37c4 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:48.784787 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-16e39396-d28e-40f1-ab53-fd37d7ae7e11 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:48.797042 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-16e39396-d28e-40f1-ab53-fd37d7ae7e11 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:48.808106 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-67845aaf-87b7-46a4-85a9-9b5e39d29a4c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:48.870174 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6e6bf517-bc59-432c-9b3c-ed2f34763b1c req-a6ff269b-cc69-49ac-82ea-d5df3cb99196 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 210 time: 0.0610037
Jun 01 06:15:48.920784 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-16e39396-d28e-40f1-ab53-fd37d7ae7e11 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:48.931336 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2784bfcb-7e2d-4678-b43b-fed08c52d2d2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:48.933923 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-16e39396-d28e-40f1-ab53-fd37d7ae7e11 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:48.942870 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:48.952231 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2784bfcb-7e2d-4678-b43b-fed08c52d2d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:48.993475 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-2784bfcb-7e2d-4678-b43b-fed08c52d2d2 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=d5ccc33320a0421784679df83360633e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4923599
Jun 01 06:15:48.998311 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 37564) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:49.023419 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16e39396-d28e-40f1-ab53-fd37d7ae7e11 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c83188e2-49d8-4d05-baf6-9434ff163733,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:49.031599 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-16e39396-d28e-40f1-ab53-fd37d7ae7e11 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=f45e49f4223d480caa56bf039d9d37c4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5769691
Jun 01 06:15:49.032620 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37570) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:49.033637 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-16e39396-d28e-40f1-ab53-fd37d7ae7e11 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:49.037067 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-5d44a281-3bd6-4e85-ab44-2f64d9174c9e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.072s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:49.131030 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ef5c124e-fb9b-446c-8665-bd0cce163713 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:49.160449 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2784bfcb-7e2d-4678-b43b-fed08c52d2d2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e005f6dd-1733-4d24-8f5f-68a0ebb770a7,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:49.160710 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.l3_agent_scheduler [req-ea265add-8801-43fe-a81b-82825d9d5e84 req-67845aaf-87b7-46a4-85a9-9b5e39d29a4c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Router b7bdc21e-592c-4bbf-87c9-5eba5676579e has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92229) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:15:49.164024 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ef5c124e-fb9b-446c-8665-bd0cce163713 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:49.170570 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e3af1740-76f2-442b-8cb6-e14c3bfd3ed3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:49.172043 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-2784bfcb-7e2d-4678-b43b-fed08c52d2d2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:49.231130 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ef5c124e-fb9b-446c-8665-bd0cce163713 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:49.236734 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-af8da014-d2c0-47b7-bc40-8a018fba5e96 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:49.271617 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e3af1740-76f2-442b-8cb6-e14c3bfd3ed3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:49.343478 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef5c124e-fb9b-446c-8665-bd0cce163713 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c83188e2-49d8-4d05-baf6-9434ff163733,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:49.345743 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-ef5c124e-fb9b-446c-8665-bd0cce163713 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:49.354580 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ef5c124e-fb9b-446c-8665-bd0cce163713 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:49.358644 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-ef5c124e-fb9b-446c-8665-bd0cce163713 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/c83188e2-49d8-4d05-baf6-9434ff163733 HTTP/1.1" status: 204  len: 168 time: 0.3230965
Jun 01 06:15:49.433670 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-ea265add-8801-43fe-a81b-82825d9d5e84 req-67845aaf-87b7-46a4-85a9-9b5e39d29a4c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92229) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:15:49.446045 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a56b4217-0d88-4805-9078-381b86c6d4ec None None] Sync routers for ids ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:15:49.464846 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a56b4217-0d88-4805-9078-381b86c6d4ec None None] Routers {'b7bdc21e-592c-4bbf-87c9-5eba5676579e'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:15:49.465506 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-a56b4217-0d88-4805-9078-381b86c6d4ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b26d3f70>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:15:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:49.530088 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-ea265add-8801-43fe-a81b-82825d9d5e84 req-67845aaf-87b7-46a4-85a9-9b5e39d29a4c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] No DVR routers for this DVR port 826848c6-a93a-4712-82dd-39e403bcb79e on host hv-cinder-79388 {{(pid=92229) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:15:49.531693 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e3af1740-76f2-442b-8cb6-e14c3bfd3ed3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:49.542936 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-ea265add-8801-43fe-a81b-82825d9d5e84 req-67845aaf-87b7-46a4-85a9-9b5e39d29a4c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:49.551525 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ce49775b-2141-443a-9c30-f2d851ee5f1f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:49.566095 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1385f5c8-2a7a-45b1-a982-6f897700aa17', 'name': 'network-vif-deleted', 'tag': '826848c6-a93a-4712-82dd-39e403bcb79e'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:15:49.574741 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-40c5b850-1db5-4edd-9fcf-38b7f7170391" -d '{"events": [{"server_uuid": "1385f5c8-2a7a-45b1-a982-6f897700aa17", "name": "network-vif-deleted", "tag": "826848c6-a93a-4712-82dd-39e403bcb79e"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:15:49.579490 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ea265add-8801-43fe-a81b-82825d9d5e84 req-67845aaf-87b7-46a4-85a9-9b5e39d29a4c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.48 "DELETE /v2.0/ports/826848c6-a93a-4712-82dd-39e403bcb79e HTTP/1.1" status: 204  len: 173 time: 1.7151976
Jun 01 06:15:49.581895 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3af1740-76f2-442b-8cb6-e14c3bfd3ed3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e005f6dd-1733-4d24-8f5f-68a0ebb770a7,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:49.593153 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e3af1740-76f2-442b-8cb6-e14c3bfd3ed3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:49.596961 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-e3af1740-76f2-442b-8cb6-e14c3bfd3ed3 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/e005f6dd-1733-4d24-8f5f-68a0ebb770a7 HTTP/1.1" status: 204  len: 168 time: 0.5975652
Jun 01 06:15:49.598171 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-e3af1740-76f2-442b-8cb6-e14c3bfd3ed3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:49.676706 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:15:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f4764443-3bda-4022-801e-950737a9075f x-openstack-request-id: req-f4764443-3bda-4022-801e-950737a9075f {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:15:49.677323 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1385f5c8-2a7a-45b1-a982-6f897700aa17", "name": "network-vif-deleted", "tag": "826848c6-a93a-4712-82dd-39e403bcb79e", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:15:49.677323 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-f4764443-3bda-4022-801e-950737a9075f {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:15:49.677877 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1385f5c8-2a7a-45b1-a982-6f897700aa17', 'name': 'network-vif-deleted', 'tag': '826848c6-a93a-4712-82dd-39e403bcb79e', 'status': 'completed', 'code': 200}
Jun 01 06:15:49.762360 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-a56b4217-0d88-4805-9078-381b86c6d4ec None None] Set router b7bdc21e-592c-4bbf-87c9-5eba5676579e gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:15:49.814040 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37582) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:49.835014 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a0f84972-3f08-4380-8b28-55728647a246 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:49.851904 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-a0f84972-3f08-4380-8b28-55728647a246 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:49.858025 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-a0f84972-3f08-4380-8b28-55728647a246 admin admin] Usage tracker for resource:security_group_rule and tenant:001bf40367ea4143b6f417606d445ace is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:49.861614 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-a0f84972-3f08-4380-8b28-55728647a246 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:49.868659 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-a0f84972-3f08-4380-8b28-55728647a246 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:49.973995 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a0f84972-3f08-4380-8b28-55728647a246 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:49.980398 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a0f84972-3f08-4380-8b28-55728647a246 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:49.998105 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-8fe403ac-c6c5-41b4-b608-5cc6e3c2ed19 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:50.061547 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-a0f84972-3f08-4380-8b28-55728647a246 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=001bf40367ea4143b6f417606d445ace&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2458055
Jun 01 06:15:50.064380 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 37592) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:50.067577 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0f84972-3f08-4380-8b28-55728647a246 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=de4fcc73-6d7a-4f7d-8320-ce285ee4627f,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:50.070725 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-a0f84972-3f08-4380-8b28-55728647a246 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:50.233990 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-a56b4217-0d88-4805-9078-381b86c6d4ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b26d3f70>, [{'id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'name': 'tempest-AttachVolumeShelveTestJSON-921884409-router', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20'}], 'enable_snat': True}, 'gw_port_id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:24Z', 'updated_at': '2021-06-01T06:11:44Z', 'revision_number': 4, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'gw_port': {'id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:b4:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:27Z', 'updated_at': '2021-06-01T06:11:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '47f62b29-867e-4af1-9330-02c97cb95473', 'name': '', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'mac_address': 'fa:16:3e:8c:f8:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:39Z', 'updated_at': '2021-06-01T06:11:57Z', 'revision_number': 5, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'subnets': [{'id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:50.235976 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-e3f1d16a-31ad-452f-bb32-8396d00072ae req-6fa9961d-6819-4df3-aa0f-2ba3672d5654 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Synchronizing usage tracker for tenant:0f63ca6fed3e47a6a676979240aef5c0 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:15:50.243469 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a56b4217-0d88-4805-9078-381b86c6d4ec None None] Checking router: b7bdc21e-592c-4bbf-87c9-5eba5676579e for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:15:50.246225 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37602) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:50.274891 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a56b4217-0d88-4805-9078-381b86c6d4ec None None] Routers {'b7bdc21e-592c-4bbf-87c9-5eba5676579e'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:15:50.275565 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-a56b4217-0d88-4805-9078-381b86c6d4ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b26d3f70>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:15:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:50.294099 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-e3f1d16a-31ad-452f-bb32-8396d00072ae req-6fa9961d-6819-4df3-aa0f-2ba3672d5654 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Unset dirty status for tenant:0f63ca6fed3e47a6a676979240aef5c0 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:15:50.295252 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e3f1d16a-31ad-452f-bb32-8396d00072ae req-6fa9961d-6819-4df3-aa0f-2ba3672d5654 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=1385f5c8-2a7a-45b1-a982-6f897700aa17 HTTP/1.1" status: 200  len: 210 time: 0.1462572
Jun 01 06:15:50.312659 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b2f53fc0-edf2-4fbb-9f1b-313969729846 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:50.355508 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_v2 [None req-b8b15a96-c8e0-4c74-a8c6-b27aefb0acf6 admin admin] Deleting subnet c6893b02-9e5e-4658-acac-8bef895b0956 {{(pid=92230) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 06:15:50.360361 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b8b15a96-c8e0-4c74-a8c6-b27aefb0acf6 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:50.368515 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b2f53fc0-edf2-4fbb-9f1b-313969729846 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:50.384000 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 826848c6-a93a-4712-82dd-39e403bcb79e no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:15:50.419986 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b8b15a96-c8e0-4c74-a8c6-b27aefb0acf6 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2178887'] for subnet, precommit_delete_associations {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:50.438650 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b2f53fc0-edf2-4fbb-9f1b-313969729846 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:50.441784 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] No Port match for: 826848c6-a93a-4712-82dd-39e403bcb79e {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:15:50.442602 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 826848c6-a93a-4712-82dd-39e403bcb79e not bound to the agent host hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:15:50.447310 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-eb90199e-2e97-4704-b88e-ffc734c2a88c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:50.466252 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2f53fc0-edf2-4fbb-9f1b-313969729846 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=de4fcc73-6d7a-4f7d-8320-ce285ee4627f,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:50.475311 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b2f53fc0-edf2-4fbb-9f1b-313969729846 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:50.482259 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b2f53fc0-edf2-4fbb-9f1b-313969729846 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:50.486553 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-b2f53fc0-edf2-4fbb-9f1b-313969729846 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/de4fcc73-6d7a-4f7d-8320-ce285ee4627f HTTP/1.1" status: 204  len: 168 time: 0.4209533
Jun 01 06:15:50.504510 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b8b15a96-c8e0-4c74-a8c6-b27aefb0acf6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8086245'] for subnet, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:50.601488 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-a56b4217-0d88-4805-9078-381b86c6d4ec None None] Set router b7bdc21e-592c-4bbf-87c9-5eba5676579e gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:15:50.840482 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b8b15a96-c8e0-4c74-a8c6-b27aefb0acf6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8087120', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2445502', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1981527'] for subnet, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:50.846891 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:50.894586 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8b15a96-c8e0-4c74-a8c6-b27aefb0acf6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c6893b02-9e5e-4658-acac-8bef895b0956,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:50.898014 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-b8b15a96-c8e0-4c74-a8c6-b27aefb0acf6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:50.901436 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b8b15a96-c8e0-4c74-a8c6-b27aefb0acf6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:50.914108 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-b8b15a96-c8e0-4c74-a8c6-b27aefb0acf6 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/c6893b02-9e5e-4658-acac-8bef895b0956 HTTP/1.1" status: 204  len: 168 time: 0.6665871
Jun 01 06:15:50.917223 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 37628) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:51.066219 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-49b59ad3-d908-455d-9aa8-f70c0daa0123 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8063377'] for network, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:51.098439 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-a56b4217-0d88-4805-9078-381b86c6d4ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b26d3f70>, [{'id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'name': 'tempest-AttachVolumeShelveTestJSON-921884409-router', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20'}], 'enable_snat': True}, 'gw_port_id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:24Z', 'updated_at': '2021-06-01T06:11:44Z', 'revision_number': 4, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'gw_port': {'id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:b4:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:27Z', 'updated_at': '2021-06-01T06:11:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '47f62b29-867e-4af1-9330-02c97cb95473', 'name': '', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'mac_address': 'fa:16:3e:8c:f8:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:39Z', 'updated_at': '2021-06-01T06:11:57Z', 'revision_number': 5, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'subnets': [{'id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:51.112475 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a56b4217-0d88-4805-9078-381b86c6d4ec None None] The sync data for ids ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'] in dv-cinder-793885-1-iscsi is: [{'id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'name': 'tempest-AttachVolumeShelveTestJSON-921884409-router', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20'}], 'enable_snat': True}, 'gw_port_id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:24Z', 'updated_at': '2021-06-01T06:11:44Z', 'revision_number': 4, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'gw_port': {'id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:b4:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:27Z', 'updated_at': '2021-06-01T06:11:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '47f62b29-867e-4af1-9330-02c97cb95473', 'name': '', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'mac_address': 'fa:16:3e:8c:f8:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:39Z', 'updated_at': '2021-06-01T06:11:57Z', 'revision_number': 5, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'subnets': [{'id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:15:51.242025 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-49b59ad3-d908-455d-9aa8-f70c0daa0123 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8093290', 'neutron.services.segments.db._delete_segments_for_network-8788497006300'] for network, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:51.258999 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-49b59ad3-d908-455d-9aa8-f70c0daa0123 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe3b1d03340>,) {'filters': {'network_id': ['a6c6ac39-c2dd-414b-b2c1-db0b208abb9a']}} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:51.278376 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-49b59ad3-d908-455d-9aa8-f70c0daa0123 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b1d03340>, 'c333deab-77ad-4250-916e-537423452613') {'for_net_delete': True} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:51.278658 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-49b59ad3-d908-455d-9aa8-f70c0daa0123 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b1d03340>, 'c333deab-77ad-4250-916e-537423452613') {} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:51.291516 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-49b59ad3-d908-455d-9aa8-f70c0daa0123 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8788497014941', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2127091'] for segment, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:51.315682 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-49b59ad3-d908-455d-9aa8-f70c0daa0123 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:51.331660 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-49b59ad3-d908-455d-9aa8-f70c0daa0123 admin admin] Releasing vlan 236 on physical network physnet1 to pool {{(pid=92229) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 06:15:51.333115 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-49b59ad3-d908-455d-9aa8-f70c0daa0123 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2077367'] for segment, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:51.381427 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37646) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]: Traceback (most recent call last):
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:     timer()
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:     cb(*args, **kw)
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:     return func(*args, **kwargs)
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:     self._notify()
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:     self.callback(batched_events)
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:     event.method(event)
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:     return f(self, *a, **k)
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self._get(url).json()
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self.request(url, 'GET', **kwargs)
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 06:15:51.434551 dv-cinder-793885-1-iscsi neutron-server[92229]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 06:15:51.494326 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-49b59ad3-d908-455d-9aa8-f70c0daa0123 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8093283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-745674'] for network, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:51.495612 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-faf67fbc-941b-4674-b8d4-b01c2dfc8504 None None] New status for floating IP 8639dc42-b15e-4dfb-b648-ca0a9c38fd05: DOWN {{(pid=92232) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 06:15:51.504902 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-49b59ad3-d908-455d-9aa8-f70c0daa0123 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:51.508817 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:51.558380 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49b59ad3-d908-455d-9aa8-f70c0daa0123 admin admin] Pushing event deleted for resources: {'Network': ['ID=a6c6ac39-c2dd-414b-b2c1-db0b208abb9a,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:51.568502 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-49b59ad3-d908-455d-9aa8-f70c0daa0123 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:51.569337 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-49b59ad3-d908-455d-9aa8-f70c0daa0123 admin admin] 10.222.0.25 "DELETE /v2.0/networks/a6c6ac39-c2dd-414b-b2c1-db0b208abb9a HTTP/1.1" status: 204  len: 168 time: 0.6510088
Jun 01 06:15:51.569717 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37660) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:51.658418 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-775dac32-ba4e-4115-a976-2ac2bee35c20 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:51.686214 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-775dac32-ba4e-4115-a976-2ac2bee35c20 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:51.691872 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-224905f9-c96e-4ffe-a108-1a292122bd3d tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:51.734865 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-224905f9-c96e-4ffe-a108-1a292122bd3d tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:51.805252 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-775dac32-ba4e-4115-a976-2ac2bee35c20 admin admin] Usage tracker for resource:security_group_rule and tenant:41e0a9ca79ab4e09b69871d6ee10e01a is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:51.815731 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-775dac32-ba4e-4115-a976-2ac2bee35c20 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:51.825976 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-775dac32-ba4e-4115-a976-2ac2bee35c20 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:51.833632 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-224905f9-c96e-4ffe-a108-1a292122bd3d tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:51.845049 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-b08b002e-f3f5-4c4a-9a12-24774db844c1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:51.874905 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-224905f9-c96e-4ffe-a108-1a292122bd3d tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d244799f-12ae-4ce0-9252-891377721dbc,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:51.886874 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-224905f9-c96e-4ffe-a108-1a292122bd3d tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:51.916817 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 37680) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:51.925414 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-224905f9-c96e-4ffe-a108-1a292122bd3d tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:51.929472 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-224905f9-c96e-4ffe-a108-1a292122bd3d tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "DELETE /v2.0/security-groups/d244799f-12ae-4ce0-9252-891377721dbc HTTP/1.1" status: 204  len: 168 time: 0.3557539
Jun 01 06:15:51.929472 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37684) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:51.956756 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.api.v2.resource [None req-86531078-b22c-48e6-9bbd-588724ebb974 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] show failed (client error): The resource could not be found.
Jun 01 06:15:51.957899 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-86531078-b22c-48e6-9bbd-588724ebb974 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups/d244799f-12ae-4ce0-9252-891377721dbc HTTP/1.1" status: 404  len: 347 time: 0.0275192
Jun 01 06:15:51.960861 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37688) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:51.980375 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-a7b69c41-01c8-404d-a859-201a128df1db admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=dd97906039e7487cbb91b21981aa107c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0619745
Jun 01 06:15:51.981673 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 37692) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:52.046327 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-db1d2165-8be6-439d-ae29-eadcb74b120c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:52.076204 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-db1d2165-8be6-439d-ae29-eadcb74b120c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:52.132470 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-db1d2165-8be6-439d-ae29-eadcb74b120c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:52.137993 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-705352b6-febb-4ece-927b-13c325bd002e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:52.152133 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db1d2165-8be6-439d-ae29-eadcb74b120c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce35921e-6eb2-4165-8e91-1e30ec1ca7b9,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:52.155283 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-db1d2165-8be6-439d-ae29-eadcb74b120c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:52.165378 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-db1d2165-8be6-439d-ae29-eadcb74b120c admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:52.167091 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-db1d2165-8be6-439d-ae29-eadcb74b120c admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/ce35921e-6eb2-4165-8e91-1e30ec1ca7b9 HTTP/1.1" status: 204  len: 168 time: 0.1843786
Jun 01 06:15:52.186911 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-775dac32-ba4e-4115-a976-2ac2bee35c20 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:52.198471 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-775dac32-ba4e-4115-a976-2ac2bee35c20 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:52.207408 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-4d4e9c8a-1139-4d7a-aca8-b65bdc06a216 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:52.261147 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-775dac32-ba4e-4115-a976-2ac2bee35c20 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=41e0a9ca79ab4e09b69871d6ee10e01a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8786018
Jun 01 06:15:52.263924 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 37700) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:52.286227 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-775dac32-ba4e-4115-a976-2ac2bee35c20 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=60ee45ad-721f-44ca-b4d2-5eaca17bc829,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:52.295988 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-775dac32-ba4e-4115-a976-2ac2bee35c20 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:52.333286 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-7ae27270-a557-4fa7-9839-82e38c27f221 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Deleting port cf6c2ad8-5168-4ef9-ac56-cdfd43ba02ee {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:15:52.334063 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7ae27270-a557-4fa7-9839-82e38c27f221 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:52.373554 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4c480432-0fd6-49c5-aa87-3985796b4875 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:52.412270 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4c480432-0fd6-49c5-aa87-3985796b4875 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:52.486503 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4c480432-0fd6-49c5-aa87-3985796b4875 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:52.491425 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b2f53fc0-edf2-4fbb-9f1b-313969729846 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:52.504674 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c480432-0fd6-49c5-aa87-3985796b4875 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=60ee45ad-721f-44ca-b4d2-5eaca17bc829,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:52.504963 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7ae27270-a557-4fa7-9839-82e38c27f221 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:52.505547 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7ae27270-a557-4fa7-9839-82e38c27f221 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:52.514200 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-4c480432-0fd6-49c5-aa87-3985796b4875 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:52.515166 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4c480432-0fd6-49c5-aa87-3985796b4875 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:52.526740 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-4c480432-0fd6-49c5-aa87-3985796b4875 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/60ee45ad-721f-44ca-b4d2-5eaca17bc829 HTTP/1.1" status: 204  len: 168 time: 0.2540269
Jun 01 06:15:52.648521 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-7ae27270-a557-4fa7-9839-82e38c27f221 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Calling delete_port for cf6c2ad8-5168-4ef9-ac56-cdfd43ba02ee owned by network:floatingip {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:15:52.791850 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7ae27270-a557-4fa7-9839-82e38c27f221 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:52.797890 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:52.855207 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ae27270-a557-4fa7-9839-82e38c27f221 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Pushing event deleted for resources: {'Port': ['ID=cf6c2ad8-5168-4ef9-ac56-cdfd43ba02ee,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:52.889863 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-7ae27270-a557-4fa7-9839-82e38c27f221 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:52.911057 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 37720) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:52.958378 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7ae27270-a557-4fa7-9839-82e38c27f221 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for floatingip, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:52.986967 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7ae27270-a557-4fa7-9839-82e38c27f221 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for floatingip, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:52.988451 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-7ae27270-a557-4fa7-9839-82e38c27f221 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "DELETE /v2.0/floatingips/8639dc42-b15e-4dfb-b648-ca0a9c38fd05 HTTP/1.1" status: 204  len: 168 time: 1.0265055
Jun 01 06:15:53.123191 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d02d5600-c9b9-4f6d-818f-18f47ee085ab admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:53.141513 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-d02d5600-c9b9-4f6d-818f-18f47ee085ab admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:53.146236 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-d02d5600-c9b9-4f6d-818f-18f47ee085ab admin admin] Usage tracker for resource:security_group_rule and tenant:cfce1eede07a456ab5dd2406289519d5 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:53.149688 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-d02d5600-c9b9-4f6d-818f-18f47ee085ab admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:53.155769 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-d02d5600-c9b9-4f6d-818f-18f47ee085ab admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:53.200620 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 37738) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:53.206796 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-8feb9422-fdb1-40aa-88c6-583e810e94fc tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1660456806', 'description': 'tempest-description--1425881002'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:15:53.216985 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-8feb9422-fdb1-40aa-88c6-583e810e94fc tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:53.222592 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-8feb9422-fdb1-40aa-88c6-583e810e94fc tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Usage tracker for resource:security_group and tenant:0f63ca6fed3e47a6a676979240aef5c0 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:53.229648 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-8feb9422-fdb1-40aa-88c6-583e810e94fc tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:53.241618 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-8feb9422-fdb1-40aa-88c6-583e810e94fc tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:53.258944 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8feb9422-fdb1-40aa-88c6-583e810e94fc tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:53.291891 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d02d5600-c9b9-4f6d-818f-18f47ee085ab admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:53.296461 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-8feb9422-fdb1-40aa-88c6-583e810e94fc tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:53.298632 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d02d5600-c9b9-4f6d-818f-18f47ee085ab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:53.308178 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-aa152b6b-2491-4881-aace-9268044ec131 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:53.315050 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-8feb9422-fdb1-40aa-88c6-583e810e94fc tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Usage tracker for resource:security_group_rule and tenant:0f63ca6fed3e47a6a676979240aef5c0 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:53.321442 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-8feb9422-fdb1-40aa-88c6-583e810e94fc tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:53.338935 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-8feb9422-fdb1-40aa-88c6-583e810e94fc tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:53.366415 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-d02d5600-c9b9-4f6d-818f-18f47ee085ab admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=cfce1eede07a456ab5dd2406289519d5&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4538751
Jun 01 06:15:53.369434 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d02d5600-c9b9-4f6d-818f-18f47ee085ab admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d4be2610-62d7-4b1c-9ab9-ab7284bf06e7,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:53.370074 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37744) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:53.378374 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-d02d5600-c9b9-4f6d-818f-18f47ee085ab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:53.443238 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8feb9422-fdb1-40aa-88c6-583e810e94fc tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:53.449146 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8feb9422-fdb1-40aa-88c6-583e810e94fc tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:53.457985 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-d394ac0b-7a2a-4d64-ace9-7b2d51a6e876 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:53.507085 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8feb9422-fdb1-40aa-88c6-583e810e94fc tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Pushing event updated for resources: {'SecurityGroup': ['ID=82c902b9-bc90-4df0-adf7-1e67365c9650,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:53.510197 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-8feb9422-fdb1-40aa-88c6-583e810e94fc tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:53.514504 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8feb9422-fdb1-40aa-88c6-583e810e94fc tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:53.516237 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-8feb9422-fdb1-40aa-88c6-583e810e94fc tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1780 time: 0.3146095
Jun 01 06:15:53.519311 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37752) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:53.531594 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-279558a2-6179-47a6-9835-e03976dcb254 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Request body: {'security_group_rule': {'security_group_id': '82c902b9-bc90-4df0-adf7-1e67365c9650', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:15:53.542151 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-279558a2-6179-47a6-9835-e03976dcb254 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:53.547262 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-954337cc-c8b1-444c-9b06-b0748f7a44a9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:53.549120 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-279558a2-6179-47a6-9835-e03976dcb254 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Usage tracker for resource:security_group_rule and tenant:0f63ca6fed3e47a6a676979240aef5c0 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:53.552544 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-279558a2-6179-47a6-9835-e03976dcb254 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:53.572371 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-279558a2-6179-47a6-9835-e03976dcb254 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:53.595327 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-954337cc-c8b1-444c-9b06-b0748f7a44a9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:53.620795 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-279558a2-6179-47a6-9835-e03976dcb254 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:53.694633 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-279558a2-6179-47a6-9835-e03976dcb254 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:53.698352 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-279558a2-6179-47a6-9835-e03976dcb254 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:53.701049 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-eee27720-2bbe-4ee3-8bf5-a2b67dbc0415 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:53.724240 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-279558a2-6179-47a6-9835-e03976dcb254 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9f923129-19dc-4438-ab13-8902367eb473,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:53.736397 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-279558a2-6179-47a6-9835-e03976dcb254 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:53.744855 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-954337cc-c8b1-444c-9b06-b0748f7a44a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:53.752797 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-dd1cce0e-0cab-4928-a3cd-c22f6a8e7b8e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:53.769246 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-954337cc-c8b1-444c-9b06-b0748f7a44a9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:53.770733 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-954337cc-c8b1-444c-9b06-b0748f7a44a9 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/d4be2610-62d7-4b1c-9ab9-ab7284bf06e7 HTTP/1.1" status: 204  len: 168 time: 0.3991823
Jun 01 06:15:53.780740 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-954337cc-c8b1-444c-9b06-b0748f7a44a9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d4be2610-62d7-4b1c-9ab9-ab7284bf06e7,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:53.791172 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-279558a2-6179-47a6-9835-e03976dcb254 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:53.795440 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 37764) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:53.796434 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-279558a2-6179-47a6-9835-e03976dcb254 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.2756968
Jun 01 06:15:53.797787 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-954337cc-c8b1-444c-9b06-b0748f7a44a9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:53.800790 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-e8ae568a-433b-4c8f-8540-bd45e43009e8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Request body: {'security_group_rule': {'security_group_id': '82c902b9-bc90-4df0-adf7-1e67365c9650', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:15:53.813377 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-e8ae568a-433b-4c8f-8540-bd45e43009e8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:53.821959 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-e8ae568a-433b-4c8f-8540-bd45e43009e8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Usage tracker for resource:security_group_rule and tenant:0f63ca6fed3e47a6a676979240aef5c0 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:53.825634 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-e8ae568a-433b-4c8f-8540-bd45e43009e8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:53.831662 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-e8ae568a-433b-4c8f-8540-bd45e43009e8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:53.855149 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e8ae568a-433b-4c8f-8540-bd45e43009e8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:53.945447 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e8ae568a-433b-4c8f-8540-bd45e43009e8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:53.953414 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e8ae568a-433b-4c8f-8540-bd45e43009e8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:53.955851 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-12e6d800-6dbb-479f-94ee-a5bc52959925 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:53.975445 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8ae568a-433b-4c8f-8540-bd45e43009e8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=64e13b53-0b10-47a0-9d4c-686ee3215d36,revision_number=0']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:53.979237 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-e8ae568a-433b-4c8f-8540-bd45e43009e8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:54.005192 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e8ae568a-433b-4c8f-8540-bd45e43009e8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:54.006636 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-e8ae568a-433b-4c8f-8540-bd45e43009e8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.2101004
Jun 01 06:15:54.010829 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 37772) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:54.016277 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Request body: {'floatingip': {'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:15:54.022775 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:54.027232 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Usage tracker for resource:floatingip and tenant:0f63ca6fed3e47a6a676979240aef5c0 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:54.031026 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:54.145756 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:54.158968 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for floatingip, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:54.321628 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edcc2173-7ede-4114-a6c6-b061bf752083 req-c41738e8-0ef5-4b64-9de0-2edf4b16a8e1 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:54.323749 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-edcc2173-7ede-4114-a6c6-b061bf752083 req-c41738e8-0ef5-4b64-9de0-2edf4b16a8e1 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.1661849
Jun 01 06:15:54.394301 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-edcc2173-7ede-4114-a6c6-b061bf752083 req-865bf918-4371-4395-a0ca-ad1a5e5eb9dd tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0629365
Jun 01 06:15:54.410880 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:54.556158 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Allocated IP 172.27.2.3 (83b812fb-2cfc-46e4-baa4-745218ea3ed2/a59d7d11-a92c-4b4f-83cf-2095ecee2b51/c6ee43ad-9301-414a-a6c7-ce69d97f565b) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:15:54.701143 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37796) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:54.709322 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:54.738905 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:54.743463 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:54.813252 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-2100526911-network', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:15:54.813987 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:15:54.816976 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:15:54.818000 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:54.820485 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:15:54.823544 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Usage tracker for resource:network and tenant:c0ca2b878b874fe4af6e7b9fa8f6cf59 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:54.826423 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:54.832185 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:54.842091 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Made reservation on behalf of c0ca2b878b874fe4af6e7b9fa8f6cf59 for: {'network': 1} {{(pid=92230) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:15:54.844521 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-8110114'] for network, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:54.850133 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Pushing event updated for resources: {'Port': ['ID=c6ee43ad-9301-414a-a6c7-ce69d97f565b,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:54.856305 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:54.857867 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:54.874904 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:54.878697 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Usage tracker for resource:security_group_rule and tenant:c0ca2b878b874fe4af6e7b9fa8f6cf59 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:54.881586 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:54.887983 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:54.904964 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:54.971123 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:54.976302 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:54.980853 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:54.983802 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-775dac32-ba4e-4115-a976-2ac2bee35c20 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:55.013689 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] vlan segment allocate from pool success with {'vlan_id': 221, 'physical_network': 'physnet1'}  {{(pid=92230) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 06:15:55.023264 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5985373d-9e4a-40aa-ae6a-494024c07169,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:55.029493 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:55.030756 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:55.031095 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.db.segments_db [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Added segment c40d74a4-eecc-4c63-8fd5-38ee39e77ccd of type vlan for network d36c4486-6b2d-4439-996b-f13c04a98cb8
Jun 01 06:15:55.059457 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8788496565589'] for network, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:55.090882 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104'] for network, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:55.092208 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:55.092788 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:55.096170 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-2a6ab747-66cf-490a-943a-1955272eeebd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:55.191266 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:55.200984 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2077419'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:55.202096 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Pushing event updated for resources: {'Network': ['ID=d36c4486-6b2d-4439-996b-f13c04a98cb8,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:55.205465 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 888 time: 0.5029006
Jun 01 06:15:55.206408 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:55.208444 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:55.208622 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37804) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:55.220688 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-10de1b2d-7ff3-4ba7-93dd-85b378b91823 admin admin] Request body: {'subnet': {'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-2100526911-subnet', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'ip_version': 4}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:15:55.225569 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Network d36c4486-6b2d-4439-996b-f13c04a98cb8 details requested by agent ovs-agent-dv-cinder-793885-1-iscsi with host dv-cinder-793885-1-iscsi {{(pid=92231) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 06:15:55.226435 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-10de1b2d-7ff3-4ba7-93dd-85b378b91823 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:55.231655 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-10de1b2d-7ff3-4ba7-93dd-85b378b91823 admin admin] Usage tracker for resource:subnet and tenant:c0ca2b878b874fe4af6e7b9fa8f6cf59 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:55.234980 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-10de1b2d-7ff3-4ba7-93dd-85b378b91823 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:55.240997 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-10de1b2d-7ff3-4ba7-93dd-85b378b91823 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:55.253964 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-10de1b2d-7ff3-4ba7-93dd-85b378b91823 admin admin] Made reservation on behalf of c0ca2b878b874fe4af6e7b9fa8f6cf59 for: {'subnet': 1} {{(pid=92230) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:15:55.257784 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-10de1b2d-7ff3-4ba7-93dd-85b378b91823 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1981512'] for subnet, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:55.319346 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Pushing event updated for resources: {'Port': ['ID=c6ee43ad-9301-414a-a6c7-ce69d97f565b,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:55.324809 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:55.336047 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-745720'] for floatingip, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:55.360971 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for floatingip, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:55.362241 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 691 time: 1.3503671
Jun 01 06:15:55.645042 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00c739ec-83f3-4086-b7a1-a2fc35355d79 req-291a3335-7e19-422b-8b9f-5051e823105f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:55.646576 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-00c739ec-83f3-4086-b7a1-a2fc35355d79 req-291a3335-7e19-422b-8b9f-5051e823105f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.1251674
Jun 01 06:15:55.727819 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-4aa9a53e-9047-405c-8f8f-fa1553ccccab tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Synchronizing usage tracker for tenant:0f63ca6fed3e47a6a676979240aef5c0 on resource:security_group {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:15:55.737083 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-00c739ec-83f3-4086-b7a1-a2fc35355d79 req-1c82bfc5-5093-45d6-9563-afbb4021c106 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0730946
Jun 01 06:15:55.737637 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-10de1b2d-7ff3-4ba7-93dd-85b378b91823 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2445565', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1981534'] for subnet, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:55.745207 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-8e6e0f58-377c-4ca2-9f59-858958cb54b9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:55.753770 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-4aa9a53e-9047-405c-8f8f-fa1553ccccab tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Unset dirty status for tenant:0f63ca6fed3e47a6a676979240aef5c0 on resource:security_group {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:15:55.754933 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-4aa9a53e-9047-405c-8f8f-fa1553ccccab tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-securitygroup--1660456806&fields=id&tenant_id=0f63ca6fed3e47a6a676979240aef5c0 HTTP/1.1" status: 200  len: 267 time: 0.1058402
Jun 01 06:15:55.825805 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10de1b2d-7ff3-4ba7-93dd-85b378b91823 admin admin] Pushing event updated for resources: {'Subnet': ['ID=27e7a9e0-ab4e-478c-aff2-55a26159dc84,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:55.828634 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-10de1b2d-7ff3-4ba7-93dd-85b378b91823 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:55.836304 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10de1b2d-7ff3-4ba7-93dd-85b378b91823 admin admin] Checking segment: {'id': 'c40d74a4-eecc-4c63-8fd5-38ee39e77ccd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 221, 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92230) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:15:55.837596 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10de1b2d-7ff3-4ba7-93dd-85b378b91823 admin admin] Network hostable DHCP agents. Network: d36c4486-6b2d-4439-996b-f13c04a98cb8, hostable agents: ['648832f0-f26e-4e29-ac0d-d97e4a75c6c4'], hosted agents: [] {{(pid=92230) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 06:15:55.855967 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10de1b2d-7ff3-4ba7-93dd-85b378b91823 admin admin] Network d36c4486-6b2d-4439-996b-f13c04a98cb8 is scheduled to be hosted by DHCP agent 648832f0-f26e-4e29-ac0d-d97e4a75c6c4 with binding_index 1 {{(pid=92230) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 06:15:55.867425 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-10de1b2d-7ff3-4ba7-93dd-85b378b91823 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793885-1-iscsi, d36c4486-6b2d-4439-996b-f13c04a98cb8) {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:15:55.882017 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-10de1b2d-7ff3-4ba7-93dd-85b378b91823 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:55.882967 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-10de1b2d-7ff3-4ba7-93dd-85b378b91823 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:55.884128 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8eca0000-796c-4cb5-98ab-295045181368 None None] Network d36c4486-6b2d-4439-996b-f13c04a98cb8 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:15:55.907692 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-10de1b2d-7ff3-4ba7-93dd-85b378b91823 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 0.6979375
Jun 01 06:15:55.909948 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37832) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:55.917338 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-2100526911-router', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:15:55.923034 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:55.928028 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Usage tracker for resource:router and tenant:c0ca2b878b874fe4af6e7b9fa8f6cf59 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:55.932398 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:55.939425 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:55.958781 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-748217', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-677'] for router, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:55.960193 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-749241', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-745574', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-726667', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-686'] for router, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:55.960939 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-06744229-e732-4dfc-800a-f8282f5bd1b8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:55.969053 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-06744229-e732-4dfc-800a-f8282f5bd1b8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/networks?id=5f973ed4-521b-4b78-9a54-1336b1302fa2 HTTP/1.1" status: 200  len: 816 time: 0.2055492
Jun 01 06:15:55.979558 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:55.988233 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-f91ff9b3-d9f2-46aa-a230-f06587dfd192 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/quotas/0f63ca6fed3e47a6a676979240aef5c0 HTTP/1.1" status: 200  len: 375 time: 0.0184040
Jun 01 06:15:56.094759 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e42a9bd0-121b-486c-94ca-d25ddf850ff9 req-c32d86b2-580c-40be-8317-8b026d3ffa73 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:56.096254 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e42a9bd0-121b-486c-94ca-d25ddf850ff9 req-c32d86b2-580c-40be-8317-8b026d3ffa73 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.48 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.1954899
Jun 01 06:15:56.116095 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-295de9d3-44a6-41d1-a4ec-83c791045296 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=0f63ca6fed3e47a6a676979240aef5c0&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1201444
Jun 01 06:15:56.273419 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp5012ce77-b332-5f05-8982-a48a8fc8d50e-d36c4486-6b2d-4439-996b-f13c04a98cb8', 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'fixed_ips': [{'subnet_id': '27e7a9e0-ab4e-478c-aff2-55a26159dc84'}]}} from dv-cinder-793885-1-iscsi. {{(pid=92231) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 06:15:56.275889 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:56.332594 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-745539', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-748171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-728'] for router, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:56.444947 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-c3958b2f-1089-4f58-9d98-c2afc8532575 service neutron] 10.222.0.25 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3278048
Jun 01 06:15:56.461153 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.db_base_plugin_common [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Allocated IP 172.20.0.2 (d36c4486-6b2d-4439-996b-f13c04a98cb8/27e7a9e0-ab4e-478c-aff2-55a26159dc84/2b49e407-7abc-4d33-9700-d1d6a09de31a) {{(pid=92231) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:15:56.576183 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-e42a9bd0-121b-486c-94ca-d25ddf850ff9 req-e1a22e06-b8c3-4ac1-a09b-9d91d53d62b4 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Deleting port 42597738-974b-4af6-a799-e37d02b057b9 {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:15:56.576529 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e42a9bd0-121b-486c-94ca-d25ddf850ff9 req-e1a22e06-b8c3-4ac1-a09b-9d91d53d62b4 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:56.686405 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-dc0e8924-677c-4f6d-b5ba-2208976d6f6a service neutron] 10.222.0.25 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2405000
Jun 01 06:15:56.703990 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Notify callbacks [] for port, precommit_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:56.717799 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Transition to ACTIVE for port object 2b49e407-7abc-4d33-9700-d1d6a09de31a will not be triggered until provisioned by entity L2. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:15:56.741299 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Transition to ACTIVE for port object 2b49e407-7abc-4d33-9700-d1d6a09de31a will not be triggered until provisioned by entity DHCP. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:15:56.750826 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:56.758314 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-e42a9bd0-121b-486c-94ca-d25ddf850ff9 req-e1a22e06-b8c3-4ac1-a09b-9d91d53d62b4 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] For port 42597738-974b-4af6-a799-e37d02b057b9, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=42597738-974b-4af6-a799-e37d02b057b9,segment=NetworkSegment(5dda6d07-db2a-40a3-815e-42df1528c630),segment_id=5dda6d07-db2a-40a3-815e-42df1528c630)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:15:56.758814 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e42a9bd0-121b-486c-94ca-d25ddf850ff9 req-e1a22e06-b8c3-4ac1-a09b-9d91d53d62b4 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:56.766543 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:56.797485 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:56.838147 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Pushing event updated for resources: {'Port': ['ID=2b49e407-7abc-4d33-9700-d1d6a09de31a,revision_number=1']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:56.879709 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Network d36c4486-6b2d-4439-996b-f13c04a98cb8 is already hosted by enough agents. {{(pid=92231) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:15:56.882476 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:56.892279 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.scheduler.base_scheduler [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Resources bound (agent type, host, resource id):  {{(pid=92231) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:15:56.895941 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Received port after_create {{(pid=92231) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:15:56.903185 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:56.903532 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:56.903892 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:56.904222 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:56.904553 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:56.904877 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:56.905348 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:56.905763 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:56.905968 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:56.906282 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:56.906596 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:56.906908 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:15:56.911843 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:56.981630 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-129ae444-ac9b-4027-9604-9578aa8c3654 req-afe10c27-e1af-4cfe-9a7d-344db2875ab0 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 210 time: 0.0892727
Jun 01 06:15:57.027984 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Attempting to bind port 2b49e407-7abc-4d33-9700-d1d6a09de31a on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:15:57.027984 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Attempting to bind port 2b49e407-7abc-4d33-9700-d1d6a09de31a by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': 'c40d74a4-eecc-4c63-8fd5-38ee39e77ccd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 221, 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8'}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:15:57.028316 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Attempting to bind port 2b49e407-7abc-4d33-9700-d1d6a09de31a on network d36c4486-6b2d-4439-996b-f13c04a98cb8 {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:15:57.036780 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 15, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:15:57.037229 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Checking segment: {'id': 'c40d74a4-eecc-4c63-8fd5-38ee39e77ccd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 221, 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92231) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:15:57.037638 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:57.038159 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Bound using segment: {'id': 'c40d74a4-eecc-4c63-8fd5-38ee39e77ccd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 221, 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8'} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:15:57.038783 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Bound port: 2b49e407-7abc-4d33-9700-d1d6a09de31a, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c40d74a4-eecc-4c63-8fd5-38ee39e77ccd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 221, 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8'}}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:15:57.039178 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:57.119513 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_common [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Allocated IP 172.27.2.54 (83b812fb-2cfc-46e4-baa4-745218ea3ed2/a59d7d11-a92c-4b4f-83cf-2095ecee2b51/7e398897-85c4-48cb-8059-cbb26d0f11bb) {{(pid=92230) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:15:57.145839 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] For port 2b49e407-7abc-4d33-9700-d1d6a09de31a, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92231) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:15:57.150385 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] For port 2b49e407-7abc-4d33-9700-d1d6a09de31a, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=2b49e407-7abc-4d33-9700-d1d6a09de31a,segment=NetworkSegment(c40d74a4-eecc-4c63-8fd5-38ee39e77ccd),segment_id=c40d74a4-eecc-4c63-8fd5-38ee39e77ccd)] {{(pid=92231) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:15:57.160788 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:57.171580 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:57.216490 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecae9208-5548-41e9-a571-74e04bcb9612 req-90320906-a5c2-4dcd-9d0a-1887277ccd7a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:57.218053 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ecae9208-5548-41e9-a571-74e04bcb9612 req-90320906-a5c2-4dcd-9d0a-1887277ccd7a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 945 time: 0.3244927
Jun 01 06:15:57.250567 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e42a9bd0-121b-486c-94ca-d25ddf850ff9 req-e1a22e06-b8c3-4ac1-a09b-9d91d53d62b4 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:57.250930 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e42a9bd0-121b-486c-94ca-d25ddf850ff9 req-e1a22e06-b8c3-4ac1-a09b-9d91d53d62b4 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-745720'] for floatingip, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:57.256976 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.db.l3_db [req-e42a9bd0-121b-486c-94ca-d25ddf850ff9 req-e1a22e06-b8c3-4ac1-a09b-9d91d53d62b4 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Floating IP 1b37b499-e96c-4dad-ad26-5ddaa7ba946f disassociated. External IP: 172.27.2.87, port: 42597738-974b-4af6-a799-e37d02b057b9.
Jun 01 06:15:57.257414 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-e42a9bd0-121b-486c-94ca-d25ddf850ff9 req-e1a22e06-b8c3-4ac1-a09b-9d91d53d62b4 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Calling delete_port for 42597738-974b-4af6-a799-e37d02b057b9 owned by compute:nova {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:15:57.293348 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Pushing event updated for resources: {'Port': ['ID=2b49e407-7abc-4d33-9700-d1d6a09de31a,revision_number=2']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:57.298904 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:57.313774 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ecae9208-5548-41e9-a571-74e04bcb9612 req-a0889226-692c-44d4-b71f-095643037284 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=932cfb13-85ed-405d-8a3d-cd7d8f3bab94&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0880337
Jun 01 06:15:57.361285 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:57.409402 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:57.416510 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-7640d7ac-3d31-4590-b1a1-620d46579f76 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:57.460037 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e42a9bd0-121b-486c-94ca-d25ddf850ff9 req-e1a22e06-b8c3-4ac1-a09b-9d91d53d62b4 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:57.468496 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:57.507242 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:15:57.512209 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:15:57.526320 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Received port after_create {{(pid=92230) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:15:57.575372 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1a22e06-b8c3-4ac1-a09b-9d91d53d62b4 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Pushing event deleted for resources: {'Port': ['ID=42597738-974b-4af6-a799-e37d02b057b9,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:57.579672 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-e1a22e06-b8c3-4ac1-a09b-9d91d53d62b4 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:57.580480 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Pushing event updated for resources: {'Port': ['ID=7e398897-85c4-48cb-8059-cbb26d0f11bb,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:57.583650 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:15:57.832511 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.l3_agent_scheduler [req-e42a9bd0-121b-486c-94ca-d25ddf850ff9 req-e1a22e06-b8c3-4ac1-a09b-9d91d53d62b4 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Router f8aef563-57d3-45c3-afd4-23442c8f572d has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92229) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:15:58.055603 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-e42a9bd0-121b-486c-94ca-d25ddf850ff9 req-e1a22e06-b8c3-4ac1-a09b-9d91d53d62b4 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92229) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:15:58.069312 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f793c66-9b43-400d-a476-081a8f9acc62 None None] Sync routers for ids ['f8aef563-57d3-45c3-afd4-23442c8f572d'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:15:58.086194 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f793c66-9b43-400d-a476-081a8f9acc62 None None] Routers {'f8aef563-57d3-45c3-afd4-23442c8f572d'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:15:58.087019 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-0f793c66-9b43-400d-a476-081a8f9acc62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b28365e0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:15:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['f8aef563-57d3-45c3-afd4-23442c8f572d'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:58.120973 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:58.232298 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-e42a9bd0-121b-486c-94ca-d25ddf850ff9 req-e1a22e06-b8c3-4ac1-a09b-9d91d53d62b4 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] No DVR routers for this DVR port 42597738-974b-4af6-a799-e37d02b057b9 on host hv-cinder-79388 {{(pid=92229) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:15:58.234860 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e42a9bd0-121b-486c-94ca-d25ddf850ff9 req-e1a22e06-b8c3-4ac1-a09b-9d91d53d62b4 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:58.248866 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'eb18f959-9e44-4148-a4fe-8f878905f76b', 'name': 'network-vif-deleted', 'tag': '42597738-974b-4af6-a799-e37d02b057b9'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:15:58.251819 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dce0a571-8cb4-4a72-99fc-63646814e0c0" -d '{"events": [{"server_uuid": "eb18f959-9e44-4148-a4fe-8f878905f76b", "name": "network-vif-deleted", "tag": "42597738-974b-4af6-a799-e37d02b057b9"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:15:58.261940 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e42a9bd0-121b-486c-94ca-d25ddf850ff9 req-e1a22e06-b8c3-4ac1-a09b-9d91d53d62b4 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.48 "DELETE /v2.0/ports/42597738-974b-4af6-a799-e37d02b057b9 HTTP/1.1" status: 204  len: 173 time: 2.0651677
Jun 01 06:15:58.279114 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 2b49e407-7abc-4d33-9700-d1d6a09de31a up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:15:58.361738 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 42597738-974b-4af6-a799-e37d02b057b9 no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:15:58.507358 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] No Port match for: 42597738-974b-4af6-a799-e37d02b057b9 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:15:58.516845 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:15:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6e8f4bd8-c85f-4ab6-82f8-a39baec8dbaa x-openstack-request-id: req-6e8f4bd8-c85f-4ab6-82f8-a39baec8dbaa {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:15:58.517393 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "eb18f959-9e44-4148-a4fe-8f878905f76b", "name": "network-vif-deleted", "tag": "42597738-974b-4af6-a799-e37d02b057b9", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:15:58.517478 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-6e8f4bd8-c85f-4ab6-82f8-a39baec8dbaa {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:15:58.517785 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 42597738-974b-4af6-a799-e37d02b057b9 not bound to the agent host hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:15:58.517895 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'eb18f959-9e44-4148-a4fe-8f878905f76b', 'name': 'network-vif-deleted', 'tag': '42597738-974b-4af6-a799-e37d02b057b9', 'status': 'completed', 'code': 200}
Jun 01 06:15:58.555501 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-87e71afd-117d-4bbc-994f-ffd18298de17 req-ccc92404-dba1-44f8-8821-4dc3481518c9 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 210 time: 0.3074694
Jun 01 06:15:58.679554 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port 2b49e407-7abc-4d33-9700-d1d6a09de31a completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:15:58.700033 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-0f793c66-9b43-400d-a476-081a8f9acc62 None None] Set router f8aef563-57d3-45c3-afd4-23442c8f572d gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:15:58.706546 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-982052cf-b1cd-4267-a866-a3b82deeb7f4 req-92a87b57-3b11-4bf2-a45f-7d0f31ae5a2f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Synchronizing usage tracker for tenant:ac4006667c3442a3910d548e9e9d22c0 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:15:58.764368 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-982052cf-b1cd-4267-a866-a3b82deeb7f4 req-92a87b57-3b11-4bf2-a45f-7d0f31ae5a2f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Unset dirty status for tenant:ac4006667c3442a3910d548e9e9d22c0 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:15:58.766760 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-982052cf-b1cd-4267-a866-a3b82deeb7f4 req-92a87b57-3b11-4bf2-a45f-7d0f31ae5a2f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=eb18f959-9e44-4148-a4fe-8f878905f76b HTTP/1.1" status: 200  len: 210 time: 0.1846220
Jun 01 06:15:58.785141 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b07dde3-04d4-4345-ba1d-a63bad3a3b4a None None] Network d36c4486-6b2d-4439-996b-f13c04a98cb8 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:15:58.828107 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-ff54c070-40e2-461d-96bc-8dbcd75cc0dd tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:15:58.829686 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-ff54c070-40e2-461d-96bc-8dbcd75cc0dd tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.48 "GET /v2.0/networks?id=5f973ed4-521b-4b78-9a54-1336b1302fa2 HTTP/1.1" status: 200  len: 816 time: 0.3110645
Jun 01 06:15:58.886634 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-748208', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-745472'] for router, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:58.941260 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-01505582-1ff8-4040-865b-c39722c8b952 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.48 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=0f63ca6fed3e47a6a676979240aef5c0 HTTP/1.1" status: 200  len: 380 time: 0.1019495
Jun 01 06:15:58.961498 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-1b1a2fb2-2ed1-4415-89d0-828b99eb38b5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Request body: {'port': {'device_id': '0504a6b7-2f41-4914-a3bb-2f908556d658', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'admin_state_up': True, 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'security_groups': ['82c902b9-bc90-4df0-adf7-1e67365c9650']}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:15:59.155568 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-1b1a2fb2-2ed1-4415-89d0-828b99eb38b5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:15:59.160385 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-1b1a2fb2-2ed1-4415-89d0-828b99eb38b5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Usage tracker for resource:port and tenant:0f63ca6fed3e47a6a676979240aef5c0 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:15:59.164086 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-1b1a2fb2-2ed1-4415-89d0-828b99eb38b5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Quota usage for port was recalculated. Used quota:3. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:15:59.172337 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-1b1a2fb2-2ed1-4415-89d0-828b99eb38b5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:15:59.183815 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-1b1a2fb2-2ed1-4415-89d0-828b99eb38b5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Made reservation on behalf of 0f63ca6fed3e47a6a676979240aef5c0 for: {'port': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:15:59.188229 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-1b1a2fb2-2ed1-4415-89d0-828b99eb38b5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:59.218563 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-73776254-92d4-44e9-a44a-d9dc801b6647 None None] Provisioning for port 2b49e407-7abc-4d33-9700-d1d6a09de31a completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:15:59.294241 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-73776254-92d4-44e9-a44a-d9dc801b6647 None None] Provisioning complete for port 2b49e407-7abc-4d33-9700-d1d6a09de31a triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:15:59.294618 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-73776254-92d4-44e9-a44a-d9dc801b6647 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:59.298868 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Router 4b9daac3-8875-4acd-af69-09a389effcf9 is scheduled to L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 with binding_index 1 {{(pid=92230) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 06:15:59.407625 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-1b1a2fb2-2ed1-4415-89d0-828b99eb38b5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Allocated IP 172.20.0.7 (5f973ed4-521b-4b78-9a54-1336b1302fa2/6137ee10-ce13-45c9-8edb-31811502bfd7/3a7e88d5-0834-4e15-acbc-90cd1b9bca61) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:15:59.498781 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:15:59.511160 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] Sync routers for ids ['4b9daac3-8875-4acd-af69-09a389effcf9'] in dv-cinder-793885-1-iscsi {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:15:59.521063 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] Routers {'4b9daac3-8875-4acd-af69-09a389effcf9'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:15:59.522096 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b27d8820>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:15:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['4b9daac3-8875-4acd-af69-09a389effcf9'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:59.532237 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Notify callbacks [] for router, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:59.535993 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201  len: 926 time: 3.6223435
Jun 01 06:15:59.536790 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37878) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:15:59.590435 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-73776254-92d4-44e9-a44a-d9dc801b6647 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:59.645399 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-1b1a2fb2-2ed1-4415-89d0-828b99eb38b5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:59.663720 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-1b1a2fb2-2ed1-4415-89d0-828b99eb38b5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Transition to ACTIVE for port object 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 will not be triggered until provisioned by entity DHCP. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:15:59.696830 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-1b1a2fb2-2ed1-4415-89d0-828b99eb38b5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:59.703835 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-73776254-92d4-44e9-a44a-d9dc801b6647 None None] For port 2b49e407-7abc-4d33-9700-d1d6a09de31a, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=2b49e407-7abc-4d33-9700-d1d6a09de31a,segment=NetworkSegment(c40d74a4-eecc-4c63-8fd5-38ee39e77ccd),segment_id=c40d74a4-eecc-4c63-8fd5-38ee39e77ccd)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:15:59.706857 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:59.717620 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-73776254-92d4-44e9-a44a-d9dc801b6647 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:15:59.722574 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:15:59.791391 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-1b1a2fb2-2ed1-4415-89d0-828b99eb38b5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Network 5f973ed4-521b-4b78-9a54-1336b1302fa2 is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:15:59.796728 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-1b1a2fb2-2ed1-4415-89d0-828b99eb38b5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:15:59.827760 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-0f793c66-9b43-400d-a476-081a8f9acc62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b28365e0>, [{'id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'name': 'tempest-AttachVolumeTestJSON-1575365070-router', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214'}], 'enable_snat': True}, 'gw_port_id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:23Z', 'updated_at': '2021-06-01T06:11:31Z', 'revision_number': 4, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'gw_port': {'id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:02:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '8e48657d-a82c-420f-8462-d947f458adb4', 'name': '', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'mac_address': 'fa:16:3e:9f:72:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '3e980239-de35-45a0-8039-8395b5408617', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:30Z', 'updated_at': '2021-06-01T06:11:46Z', 'revision_number': 5, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'subnets': [{'id': '3e980239-de35-45a0-8039-8395b5408617', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:59.843525 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f793c66-9b43-400d-a476-081a8f9acc62 None None] Checking router: f8aef563-57d3-45c3-afd4-23442c8f572d for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:15:59.849643 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] Set router 4b9daac3-8875-4acd-af69-09a389effcf9 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:15:59.863883 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f793c66-9b43-400d-a476-081a8f9acc62 None None] Routers {'f8aef563-57d3-45c3-afd4-23442c8f572d'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:15:59.864549 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-0f793c66-9b43-400d-a476-081a8f9acc62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b28365e0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:15:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['f8aef563-57d3-45c3-afd4-23442c8f572d'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:15:59.881655 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-1b1a2fb2-2ed1-4415-89d0-828b99eb38b5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:15:59.966704 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73776254-92d4-44e9-a44a-d9dc801b6647 None None] Pushing event updated for resources: {'Port': ['ID=2b49e407-7abc-4d33-9700-d1d6a09de31a,revision_number=3']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:15:59.970080 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-73776254-92d4-44e9-a44a-d9dc801b6647 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.247s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:00.059337 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-1b1a2fb2-2ed1-4415-89d0-828b99eb38b5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:00.060345 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-1b1a2fb2-2ed1-4415-89d0-828b99eb38b5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:00.074929 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 37888) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:16:00.169127 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-43dec64b-d29d-454a-8cef-a89ebba702af None None] Provisioning complete for port 2b49e407-7abc-4d33-9700-d1d6a09de31a triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:16:00.169852 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-43dec64b-d29d-454a-8cef-a89ebba702af None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:00.190933 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-6e5fb843-414e-4ed0-a725-ceb4c7de88b2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:00.208813 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b1a2fb2-2ed1-4415-89d0-828b99eb38b5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Pushing event updated for resources: {'Port': ['ID=3a7e88d5-0834-4e15-acbc-90cd1b9bca61,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:00.210143 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 2b49e407-7abc-4d33-9700-d1d6a09de31a up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:16:00.232881 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-1b1a2fb2-2ed1-4415-89d0-828b99eb38b5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.526s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:00.256947 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-6e5fb843-414e-4ed0-a725-ceb4c7de88b2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:00.279738 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-1b1a2fb2-2ed1-4415-89d0-828b99eb38b5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.3228467
Jun 01 06:16:00.300727 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-0f793c66-9b43-400d-a476-081a8f9acc62 None None] Set router f8aef563-57d3-45c3-afd4-23442c8f572d gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:16:00.301898 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Request body: {'port': {'device_id': '0504a6b7-2f41-4914-a3bb-2f908556d658', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79388'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:16:00.374693 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23eecf7c-b0f7-4fce-b49d-90cf374e24df req-7e523fe2-111f-47b3-acd8-9ff852e8e7f3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:00.375310 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-23eecf7c-b0f7-4fce-b49d-90cf374e24df req-7e523fe2-111f-47b3-acd8-9ff852e8e7f3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Synchronizing usage tracker for tenant:0f63ca6fed3e47a6a676979240aef5c0 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:16:00.443011 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-23eecf7c-b0f7-4fce-b49d-90cf374e24df req-7e523fe2-111f-47b3-acd8-9ff852e8e7f3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Unset dirty status for tenant:0f63ca6fed3e47a6a676979240aef5c0 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:16:00.444311 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-23eecf7c-b0f7-4fce-b49d-90cf374e24df req-7e523fe2-111f-47b3-acd8-9ff852e8e7f3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 931 time: 0.6425698
Jun 01 06:16:00.470791 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b27d8820>, [{'id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'name': 'tempest-TestMinimumBasicScenario-2100526911-router', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54'}], 'enable_snat': True}, 'gw_port_id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:15:55Z', 'updated_at': '2021-06-01T06:15:57Z', 'revision_number': 3, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'gw_port': {'id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:16:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:15:56Z', 'updated_at': '2021-06-01T06:15:57Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:00.480167 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] Checking router: 4b9daac3-8875-4acd-af69-09a389effcf9 for host: dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:16:00.480511 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] Updating router 4b9daac3-8875-4acd-af69-09a389effcf9 port 7e398897-85c4-48cb-8059-cbb26d0f11bb binding host dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 06:16:00.525444 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-23eecf7c-b0f7-4fce-b49d-90cf374e24df req-ae2c2870-aa9d-4659-8c45-6b4dcfe72e34 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0734937
Jun 01 06:16:00.529195 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-6e5fb843-414e-4ed0-a725-ceb4c7de88b2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:00.542314 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-85b6cf5f-e116-4f87-b060-292df6468375 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:00.565778 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e5fb843-414e-4ed0-a725-ceb4c7de88b2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=932cfb13-85ed-405d-8a3d-cd7d8f3bab94,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:00.569921 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:00.586136 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 2b49e407-7abc-4d33-9700-d1d6a09de31a triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:16:00.586525 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:00.589091 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-6e5fb843-414e-4ed0-a725-ceb4c7de88b2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:00.622948 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:00.656938 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-6e5fb843-414e-4ed0-a725-ceb4c7de88b2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:00.660258 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-6e5fb843-414e-4ed0-a725-ceb4c7de88b2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "DELETE /v2.0/security-groups/932cfb13-85ed-405d-8a3d-cd7d8f3bab94 HTTP/1.1" status: 204  len: 168 time: 0.5821016
Jun 01 06:16:00.663146 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37896) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:16:00.726311 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.api.v2.resource [None req-96e771a2-0740-4513-828c-b6c4769033e5 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] show failed (client error): The resource could not be found.
Jun 01 06:16:00.727558 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-96e771a2-0740-4513-828c-b6c4769033e5 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups/932cfb13-85ed-405d-8a3d-cd7d8f3bab94 HTTP/1.1" status: 404  len: 347 time: 0.0626121
Jun 01 06:16:00.733034 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37900) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:16:00.950345 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-56c0c333-4b85-4ecb-bf0f-4afe5f4760a1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:00.986273 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-695a78ef-6488-46e2-8bfe-96bb56ca7835 None None] Provisioning for port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:16:01.002754 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-695a78ef-6488-46e2-8bfe-96bb56ca7835 None None] Provisioning complete for port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:16:01.003367 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-695a78ef-6488-46e2-8bfe-96bb56ca7835 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:01.084726 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-695a78ef-6488-46e2-8bfe-96bb56ca7835 None None] Port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:16:01.094160 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-0f793c66-9b43-400d-a476-081a8f9acc62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b28365e0>, [{'id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'name': 'tempest-AttachVolumeTestJSON-1575365070-router', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214'}], 'enable_snat': True}, 'gw_port_id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:23Z', 'updated_at': '2021-06-01T06:11:31Z', 'revision_number': 4, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'gw_port': {'id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:02:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '8e48657d-a82c-420f-8462-d947f458adb4', 'name': '', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'mac_address': 'fa:16:3e:9f:72:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '3e980239-de35-45a0-8039-8395b5408617', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:30Z', 'updated_at': '2021-06-01T06:11:46Z', 'revision_number': 5, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'subnets': [{'id': '3e980239-de35-45a0-8039-8395b5408617', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:01.100016 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f793c66-9b43-400d-a476-081a8f9acc62 None None] The sync data for ids ['f8aef563-57d3-45c3-afd4-23442c8f572d'] in dv-cinder-793885-1-iscsi is: [{'id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'name': 'tempest-AttachVolumeTestJSON-1575365070-router', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214'}], 'enable_snat': True}, 'gw_port_id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:23Z', 'updated_at': '2021-06-01T06:11:31Z', 'revision_number': 4, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'gw_port': {'id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:02:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '8e48657d-a82c-420f-8462-d947f458adb4', 'name': '', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'mac_address': 'fa:16:3e:9f:72:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '3e980239-de35-45a0-8039-8395b5408617', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:30Z', 'updated_at': '2021-06-01T06:11:46Z', 'revision_number': 5, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'subnets': [{'id': '3e980239-de35-45a0-8039-8395b5408617', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:16:01.120167 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 {{(pid=92229) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:16:01.128683 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:01.147229 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Transition to ACTIVE for port object 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 will not be triggered until provisioned by entity L2. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:16:01.153861 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2077419'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:01.159773 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-920b90fa-4aba-4045-b6fb-fe8cfa0199d2 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:01.186288 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] Notify callbacks [] for port, precommit_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:01.202451 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.provisioning_blocks [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] Transition to ACTIVE for port object 7e398897-85c4-48cb-8059-cbb26d0f11bb will not be triggered until provisioned by entity L2. {{(pid=92232) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:16:01.210982 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:01.217607 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-e3da4fd4-af3b-46af-828a-54d799fc9880 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:01.261516 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-26a0a4ce-c35e-4297-83a0-71e28f2a2f2e tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Deleting port 7a40d370-1281-480c-bb6e-357e54ee6080 {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:16:01.262082 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-26a0a4ce-c35e-4297-83a0-71e28f2a2f2e tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:01.339309 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] Attempting to bind port 7e398897-85c4-48cb-8059-cbb26d0f11bb on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:16:01.339703 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] Attempting to bind port 7e398897-85c4-48cb-8059-cbb26d0f11bb by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}] {{(pid=92232) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:16:01.340151 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] Attempting to bind port 7e398897-85c4-48cb-8059-cbb26d0f11bb on network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:16:01.352751 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e09d9e44-ba31-486e-8c45-6eb5d52e2cf9 None None] Pushing event updated for resources: {'Port': ['ID=7e398897-85c4-48cb-8059-cbb26d0f11bb,revision_number=2']} {{(pid=92232) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:01.356393 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 15, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:16:01.356792 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] Checking segment: {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92232) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:16:01.357309 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:01.357711 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] Bound using segment: {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'} {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:16:01.358197 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] Bound port: 7e398897-85c4-48cb-8059-cbb26d0f11bb, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}}] {{(pid=92232) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:16:01.358562 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:01.402226 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e09d9e44-ba31-486e-8c45-6eb5d52e2cf9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:01.402585 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e09d9e44-ba31-486e-8c45-6eb5d52e2cf9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:01.402880 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e09d9e44-ba31-486e-8c45-6eb5d52e2cf9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:01.403201 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e09d9e44-ba31-486e-8c45-6eb5d52e2cf9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:01.405547 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e09d9e44-ba31-486e-8c45-6eb5d52e2cf9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:01.405912 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e09d9e44-ba31-486e-8c45-6eb5d52e2cf9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:01.406231 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e09d9e44-ba31-486e-8c45-6eb5d52e2cf9 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:01.406549 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e09d9e44-ba31-486e-8c45-6eb5d52e2cf9 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:01.406880 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e09d9e44-ba31-486e-8c45-6eb5d52e2cf9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:01.407192 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e09d9e44-ba31-486e-8c45-6eb5d52e2cf9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:01.407501 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e09d9e44-ba31-486e-8c45-6eb5d52e2cf9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:01.410486 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e09d9e44-ba31-486e-8c45-6eb5d52e2cf9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92232) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:01.429530 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-e09d9e44-ba31-486e-8c45-6eb5d52e2cf9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:01.469506 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.db [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] For port 7e398897-85c4-48cb-8059-cbb26d0f11bb, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92232) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:16:01.477248 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.db [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] For port 7e398897-85c4-48cb-8059-cbb26d0f11bb, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=7e398897-85c4-48cb-8059-cbb26d0f11bb,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92232) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:16:01.482584 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:01.487627 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-c639d7f2-7c5d-4fdf-a4c2-6c38a595b20d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:01.496123 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Pushing event updated for resources: {'Port': ['ID=3a7e88d5-0834-4e15-acbc-90cd1b9bca61,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:01.500645 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.341s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:01.532205 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_common [None req-56c0c333-4b85-4ecb-bf0f-4afe5f4760a1 admin admin] Allocated IP 172.20.0.1 (d36c4486-6b2d-4439-996b-f13c04a98cb8/27e7a9e0-ab4e-478c-aff2-55a26159dc84/ac9595c2-fb73-47ad-a4a7-a8318ad01d8c) {{(pid=92230) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:16:01.540698 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57eaa603-9442-41a0-8e22-d2988001ad28 None None] New status for floating IP 1b37b499-e96c-4dad-ad26-5ddaa7ba946f: DOWN {{(pid=92231) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 06:16:01.599639 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] Routers {'4b9daac3-8875-4acd-af69-09a389effcf9'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:16:01.600301 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b27d8820>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:15:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['4b9daac3-8875-4acd-af69-09a389effcf9'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:01.612175 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Attempting to bind port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 on host hv-cinder-79388 for vnic_type normal with profile  {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:16:01.612644 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Attempting to bind port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 by drivers openvswitch,hyperv on host hv-cinder-79388 at level 0 using segments [{'id': '79adeacf-7d8b-48ea-a63b-df4d7bfff135', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 245, 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2'}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:16:01.612966 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Attempting to bind port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 on network 5f973ed4-521b-4b78-9a54-1336b1302fa2 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:16:01.618056 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 on network 5f973ed4-521b-4b78-9a54-1336b1302fa2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79388 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 06:16:01.618378 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Attempting to bind port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 on network 5f973ed4-521b-4b78-9a54-1336b1302fa2 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:16:01.624341 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Checking agent: {'id': '56148394-2131-4d06-bcfa-c032301591b8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79388', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'started_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 15, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:16:01.625338 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Checking segment: {'id': '79adeacf-7d8b-48ea-a63b-df4d7bfff135', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 245, 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:16:01.625739 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Bound using segment: {'id': '79adeacf-7d8b-48ea-a63b-df4d7bfff135', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 245, 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2'} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:16:01.626170 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Bound port: 3a7e88d5-0834-4e15-acbc-90cd1b9bca61, host: hv-cinder-79388, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '79adeacf-7d8b-48ea-a63b-df4d7bfff135', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 245, 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2'}}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:16:01.626636 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:01.703106 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-26a0a4ce-c35e-4297-83a0-71e28f2a2f2e tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:01.703658 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-26a0a4ce-c35e-4297-83a0-71e28f2a2f2e tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:01.814078 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] For port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61, host hv-cinder-79388, cleared binding levels {{(pid=92229) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:16:01.819815 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] For port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61, host hv-cinder-79388, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=3a7e88d5-0834-4e15-acbc-90cd1b9bca61,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92229) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:16:01.830327 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2077419'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:01.836098 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:01.839887 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] Set router 4b9daac3-8875-4acd-af69-09a389effcf9 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:16:01.857048 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-26a0a4ce-c35e-4297-83a0-71e28f2a2f2e tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Calling delete_port for 7a40d370-1281-480c-bb6e-357e54ee6080 owned by network:floatingip {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:16:01.917020 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c7dca16-2ea7-4a63-8c75-e3ab4abdadda req-a4739722-b018-4d62-ad22-1365c72803de tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:01.925314 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4c7dca16-2ea7-4a63-8c75-e3ab4abdadda req-a4739722-b018-4d62-ad22-1365c72803de tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 943 time: 0.2149758
Jun 01 06:16:01.930574 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:01.931546 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:01.933292 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] 10.222.0.48 "PUT /v2.0/ports/3a7e88d5-0834-4e15-acbc-90cd1b9bca61 HTTP/1.1" status: 200  len: 1093 time: 1.6382456
Jun 01 06:16:01.933822 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0504a6b7-2f41-4914-a3bb-2f908556d658', 'tag': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:16:01.936511 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7f606044-4d2f-46c3-8a19-bcaf2f6e318f" -d '{"events": [{"name": "network-changed", "server_uuid": "0504a6b7-2f41-4914-a3bb-2f908556d658", "tag": "3a7e88d5-0834-4e15-acbc-90cd1b9bca61"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:16:01.950181 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-56c0c333-4b85-4ecb-bf0f-4afe5f4760a1 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:01.988799 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.provisioning_blocks [None req-56c0c333-4b85-4ecb-bf0f-4afe5f4760a1 admin admin] Transition to ACTIVE for port object ac9595c2-fb73-47ad-a4a7-a8318ad01d8c will not be triggered until provisioned by entity DHCP. {{(pid=92230) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:16:02.059608 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:16:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-76a1c9fe-f1b2-4232-8b5b-57bd90d4477e x-openstack-request-id: req-76a1c9fe-f1b2-4232-8b5b-57bd90d4477e {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:16:02.060297 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0504a6b7-2f41-4914-a3bb-2f908556d658", "tag": "3a7e88d5-0834-4e15-acbc-90cd1b9bca61", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:16:02.060596 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-76a1c9fe-f1b2-4232-8b5b-57bd90d4477e {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:16:02.061021 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0504a6b7-2f41-4914-a3bb-2f908556d658', 'tag': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61', 'status': 'completed', 'code': 200}
Jun 01 06:16:02.106445 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Pushing event updated for resources: {'Port': ['ID=3a7e88d5-0834-4e15-acbc-90cd1b9bca61,revision_number=3']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:02.110308 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.274s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:02.120142 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-56c0c333-4b85-4ecb-bf0f-4afe5f4760a1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:02.127904 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4c7dca16-2ea7-4a63-8c75-e3ab4abdadda req-0b78f86f-3d78-4c38-907e-dd3fa93502dd tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2016788
Jun 01 06:16:02.137414 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-7ae27270-a557-4fa7-9839-82e38c27f221 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:02.167297 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-092c6c7d-5411-4dcc-825c-f40b3276ec78 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:02.169468 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-092c6c7d-5411-4dcc-825c-f40b3276ec78 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=0f63ca6fed3e47a6a676979240aef5c0&device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 1096 time: 0.1719394
Jun 01 06:16:02.228932 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e09d9e44-ba31-486e-8c45-6eb5d52e2cf9 None None] Pushing event updated for resources: {'Port': ['ID=7e398897-85c4-48cb-8059-cbb26d0f11bb,revision_number=3']} {{(pid=92232) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:02.262727 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56c0c333-4b85-4ecb-bf0f-4afe5f4760a1 admin admin] Pushing event updated for resources: {'Port': ['ID=ac9595c2-fb73-47ad-a4a7-a8318ad01d8c,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:02.278967 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-d3bb24d2-6306-4c7b-b5ea-021d4c70d872 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=3a7e88d5-0834-4e15-acbc-90cd1b9bca61 HTTP/1.1" status: 200  len: 217 time: 0.1019053
Jun 01 06:16:02.282928 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-e09d9e44-ba31-486e-8c45-6eb5d52e2cf9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.795s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:02.284318 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56c0c333-4b85-4ecb-bf0f-4afe5f4760a1 admin admin] Network d36c4486-6b2d-4439-996b-f13c04a98cb8 is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:16:02.287972 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-56c0c333-4b85-4ecb-bf0f-4afe5f4760a1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:02.288824 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-56c0c333-4b85-4ecb-bf0f-4afe5f4760a1 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:16:02.293253 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [None req-56c0c333-4b85-4ecb-bf0f-4afe5f4760a1 admin admin] Received port after_create {{(pid=92230) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:16:02.335414 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b27d8820>, [{'id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'name': 'tempest-TestMinimumBasicScenario-2100526911-router', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54'}], 'enable_snat': True}, 'gw_port_id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:15:55Z', 'updated_at': '2021-06-01T06:15:57Z', 'revision_number': 3, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'gw_port': {'id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:16:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:15:56Z', 'updated_at': '2021-06-01T06:16:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:02.341620 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-210bd88e-6920-46df-bbce-cb3b4b57765a None None] The sync data for ids ['4b9daac3-8875-4acd-af69-09a389effcf9'] in dv-cinder-793885-1-iscsi is: [{'id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'name': 'tempest-TestMinimumBasicScenario-2100526911-router', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54'}], 'enable_snat': True}, 'gw_port_id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:15:55Z', 'updated_at': '2021-06-01T06:15:57Z', 'revision_number': 3, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'gw_port': {'id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:16:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:15:56Z', 'updated_at': '2021-06-01T06:16:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}] {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:16:02.357308 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-26a0a4ce-c35e-4297-83a0-71e28f2a2f2e tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:02.365003 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-338ec948-58b4-4650-9f56-196273a83b7a tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:02.368517 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-dd75fbb8-b1f0-4cfa-8ea1-e9cf1bbcd8b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:02.369954 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-dd75fbb8-b1f0-4cfa-8ea1-e9cf1bbcd8b7 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=6137ee10-ce13-45c9-8edb-31811502bfd7 HTTP/1.1" status: 200  len: 855 time: 0.0845308
Jun 01 06:16:02.439089 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26a0a4ce-c35e-4297-83a0-71e28f2a2f2e tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Pushing event deleted for resources: {'Port': ['ID=7a40d370-1281-480c-bb6e-357e54ee6080,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:02.451059 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-26a0a4ce-c35e-4297-83a0-71e28f2a2f2e tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:02.458480 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-56c0c333-4b85-4ecb-bf0f-4afe5f4760a1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-744049'] for router_interface, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:02.481993 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-eb59ba37-42ae-473f-9472-203e3f056e60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:02.483760 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-eb59ba37-42ae-473f-9472-203e3f056e60 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=5f973ed4-521b-4b78-9a54-1336b1302fa2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1060283
Jun 01 06:16:02.590801 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-9deff735-2d1b-40cd-8ce8-e724f3269df9 None None] Provisioning for port ac9595c2-fb73-47ad-a4a7-a8318ad01d8c completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:16:02.601968 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-9deff735-2d1b-40cd-8ce8-e724f3269df9 None None] Provisioning complete for port ac9595c2-fb73-47ad-a4a7-a8318ad01d8c triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:16:02.602337 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-9deff735-2d1b-40cd-8ce8-e724f3269df9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:02.720223 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-9deff735-2d1b-40cd-8ce8-e724f3269df9 None None] Port ac9595c2-fb73-47ad-a4a7-a8318ad01d8c cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:16:02.741566 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-890c5302-c343-4c0e-a6c6-66a83d365503 service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2507761
Jun 01 06:16:02.765323 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-26a0a4ce-c35e-4297-83a0-71e28f2a2f2e tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for floatingip, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:02.820819 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-26a0a4ce-c35e-4297-83a0-71e28f2a2f2e tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for floatingip, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:02.822623 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-26a0a4ce-c35e-4297-83a0-71e28f2a2f2e tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "DELETE /v2.0/floatingips/1b37b499-e96c-4dad-ad26-5ddaa7ba946f HTTP/1.1" status: 204  len: 168 time: 2.0886087
Jun 01 06:16:02.922909 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-56c0c333-4b85-4ecb-bf0f-4afe5f4760a1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:02.996405 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bc323c4d-a820-4a7a-8307-7cebc062fcd7 req-15f0ff38-6a20-4b7e-9764-2cd3f5c67c87 service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2487054
Jun 01 06:16:03.170177 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f606044-4d2f-46c3-8a19-bcaf2f6e318f req-b0fe1143-be29-44b4-8d42-7c538451a1fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:03.171664 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7f606044-4d2f-46c3-8a19-bcaf2f6e318f req-b0fe1143-be29-44b4-8d42-7c538451a1fb service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=0f63ca6fed3e47a6a676979240aef5c0&device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 1096 time: 0.1248477
Jun 01 06:16:03.258524 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-56c0c333-4b85-4ecb-bf0f-4afe5f4760a1 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:03.266345 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-56c0c333-4b85-4ecb-bf0f-4afe5f4760a1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2416196'] for port, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:03.299389 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37924) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:16:03.300611 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-b3a200da-c236-4404-a10d-cbf0e823381b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:03.359281 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-9564971d-18c3-42f2-bea1-5140ec1b48aa tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Request body: {'security_group': {'name': 'tempest-securitygroup--2001095692', 'description': 'tempest-description--1568164490'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:16:03.387052 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-9564971d-18c3-42f2-bea1-5140ec1b48aa tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:16:03.401804 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-9564971d-18c3-42f2-bea1-5140ec1b48aa tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Usage tracker for resource:security_group and tenant:ac4006667c3442a3910d548e9e9d22c0 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:16:03.406329 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-9564971d-18c3-42f2-bea1-5140ec1b48aa tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:16:03.416578 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-9564971d-18c3-42f2-bea1-5140ec1b48aa tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:16:03.425115 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56c0c333-4b85-4ecb-bf0f-4afe5f4760a1 admin admin] Pushing event updated for resources: {'Port': ['ID=ac9595c2-fb73-47ad-a4a7-a8318ad01d8c,revision_number=2']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:03.433834 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-56c0c333-4b85-4ecb-bf0f-4afe5f4760a1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:03.434019 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-56c0c333-4b85-4ecb-bf0f-4afe5f4760a1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-582666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-744156'] for router_interface, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:03.440643 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f606044-4d2f-46c3-8a19-bcaf2f6e318f req-01bd4364-5526-4418-a86a-1c50d2f4e3f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:03.442154 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7f606044-4d2f-46c3-8a19-bcaf2f6e318f req-01bd4364-5526-4418-a86a-1c50d2f4e3f3 service neutron] 10.222.0.48 "GET /v2.0/networks?id=5f973ed4-521b-4b78-9a54-1336b1302fa2 HTTP/1.1" status: 200  len: 917 time: 0.2629941
Jun 01 06:16:03.444725 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9564971d-18c3-42f2-bea1-5140ec1b48aa tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:03.516909 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80cd06a7-0a8b-446f-9edb-39934bdb7999 req-c6a34b55-1fb8-4972-aef3-18e20e04419f tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:03.518427 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-80cd06a7-0a8b-446f-9edb-39934bdb7999 req-c6a34b55-1fb8-4972-aef3-18e20e04419f tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 943 time: 0.1855202
Jun 01 06:16:03.529039 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7f606044-4d2f-46c3-8a19-bcaf2f6e318f req-25720960-c815-4dbe-80fd-16c34df036ab service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=3a7e88d5-0834-4e15-acbc-90cd1b9bca61 HTTP/1.1" status: 200  len: 217 time: 0.0802164
Jun 01 06:16:03.571836 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-80cd06a7-0a8b-446f-9edb-39934bdb7999 req-ae339208-b9fe-4475-b3f6-83187e5ef0ce tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0442758
Jun 01 06:16:03.651765 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-9564971d-18c3-42f2-bea1-5140ec1b48aa tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:16:03.658621 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-9564971d-18c3-42f2-bea1-5140ec1b48aa tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Usage tracker for resource:security_group_rule and tenant:ac4006667c3442a3910d548e9e9d22c0 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:16:03.662817 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-9564971d-18c3-42f2-bea1-5140ec1b48aa tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:16:03.672091 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-9564971d-18c3-42f2-bea1-5140ec1b48aa tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:16:03.732952 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56c0c333-4b85-4ecb-bf0f-4afe5f4760a1 admin admin] Network d36c4486-6b2d-4439-996b-f13c04a98cb8 is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:16:03.735879 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-56c0c333-4b85-4ecb-bf0f-4afe5f4760a1 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:16:03.867511 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9564971d-18c3-42f2-bea1-5140ec1b48aa tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:03.922564 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9564971d-18c3-42f2-bea1-5140ec1b48aa tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:03.933205 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-2784bfcb-7e2d-4678-b43b-fed08c52d2d2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:03.945551 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-64cfb721-0a42-497b-afb2-2d13cb9500ab None None] Provisioning complete for port ac9595c2-fb73-47ad-a4a7-a8318ad01d8c triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:16:03.946066 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-64cfb721-0a42-497b-afb2-2d13cb9500ab None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:04.003080 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9564971d-18c3-42f2-bea1-5140ec1b48aa tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:04.004315 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-9564971d-18c3-42f2-bea1-5140ec1b48aa tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1780 time: 0.6624517
Jun 01 06:16:04.005436 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9564971d-18c3-42f2-bea1-5140ec1b48aa tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7b7f5fd5-de63-4478-8c7a-1d742b2fa2da,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:04.007402 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-64cfb721-0a42-497b-afb2-2d13cb9500ab None None] Port ac9595c2-fb73-47ad-a4a7-a8318ad01d8c cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:16:04.007858 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 37928) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:16:04.010531 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-9564971d-18c3-42f2-bea1-5140ec1b48aa tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:04.015000 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-0831ad8e-9365-4e67-ae84-56d4a538fd11 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Request body: {'security_group_rule': {'security_group_id': '7b7f5fd5-de63-4478-8c7a-1d742b2fa2da', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:16:04.016600 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-56c0c333-4b85-4ecb-bf0f-4afe5f4760a1 admin admin] Router 4b9daac3-8875-4acd-af69-09a389effcf9 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92230) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:16:04.021037 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-0831ad8e-9365-4e67-ae84-56d4a538fd11 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:16:04.025942 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-0831ad8e-9365-4e67-ae84-56d4a538fd11 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Usage tracker for resource:security_group_rule and tenant:ac4006667c3442a3910d548e9e9d22c0 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:16:04.030107 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-0831ad8e-9365-4e67-ae84-56d4a538fd11 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:16:04.037572 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-0831ad8e-9365-4e67-ae84-56d4a538fd11 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:16:04.057925 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-0831ad8e-9365-4e67-ae84-56d4a538fd11 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:04.156445 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 7e398897-85c4-48cb-8059-cbb26d0f11bb up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:16:04.162933 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-0831ad8e-9365-4e67-ae84-56d4a538fd11 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:04.169343 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-0831ad8e-9365-4e67-ae84-56d4a538fd11 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:04.172185 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:04.195136 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0831ad8e-9365-4e67-ae84-56d4a538fd11 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4713c804-ffc7-4cc2-a143-19092fd27e11,revision_number=0']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:04.205715 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-0831ad8e-9365-4e67-ae84-56d4a538fd11 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:04.231459 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-0831ad8e-9365-4e67-ae84-56d4a538fd11 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:04.236023 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-0831ad8e-9365-4e67-ae84-56d4a538fd11 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.2260234
Jun 01 06:16:04.236842 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 37934) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:16:04.244180 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-d7a81cae-99b0-42e9-8ea9-1ea3f0dd93ed tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Request body: {'security_group_rule': {'security_group_id': '7b7f5fd5-de63-4478-8c7a-1d742b2fa2da', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:16:04.245209 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port 7e398897-85c4-48cb-8059-cbb26d0f11bb completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:16:04.249337 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-56c0c333-4b85-4ecb-bf0f-4afe5f4760a1 admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:16:04.250025 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-d7a81cae-99b0-42e9-8ea9-1ea3f0dd93ed tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:16:04.251845 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 7e398897-85c4-48cb-8059-cbb26d0f11bb triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:16:04.251996 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:04.254532 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-d7a81cae-99b0-42e9-8ea9-1ea3f0dd93ed tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Usage tracker for resource:security_group_rule and tenant:ac4006667c3442a3910d548e9e9d22c0 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:16:04.257779 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-d7a81cae-99b0-42e9-8ea9-1ea3f0dd93ed tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:16:04.269623 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-56c0c333-4b85-4ecb-bf0f-4afe5f4760a1 admin admin] 10.222.0.25 "PUT /v2.0/routers/4b9daac3-8875-4acd-af69-09a389effcf9/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.7234266
Jun 01 06:16:04.274036 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] Sync routers for ids ['4b9daac3-8875-4acd-af69-09a389effcf9'] in dv-cinder-793885-1-iscsi {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:16:04.277499 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-d7a81cae-99b0-42e9-8ea9-1ea3f0dd93ed tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:16:04.285679 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] Routers {'4b9daac3-8875-4acd-af69-09a389effcf9'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:16:04.286766 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b285d760>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:15:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['4b9daac3-8875-4acd-af69-09a389effcf9'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:04.298871 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d7a81cae-99b0-42e9-8ea9-1ea3f0dd93ed tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:04.379238 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d7a81cae-99b0-42e9-8ea9-1ea3f0dd93ed tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:04.385253 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d7a81cae-99b0-42e9-8ea9-1ea3f0dd93ed tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:04.385555 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:04.393833 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:04.403370 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port 7e398897-85c4-48cb-8059-cbb26d0f11bb, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=7e398897-85c4-48cb-8059-cbb26d0f11bb,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:16:04.408372 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:04.410866 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:04.454033 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7a81cae-99b0-42e9-8ea9-1ea3f0dd93ed tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4cd1bd84-8cc3-4035-ac3a-0a0e6aa207bd,revision_number=0']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:04.461658 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-d7a81cae-99b0-42e9-8ea9-1ea3f0dd93ed tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:04.470784 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d7a81cae-99b0-42e9-8ea9-1ea3f0dd93ed tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:04.471997 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-d7a81cae-99b0-42e9-8ea9-1ea3f0dd93ed tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.2340856
Jun 01 06:16:04.475443 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37942) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:16:04.483495 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Request body: {'floatingip': {'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:16:04.487734 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f606044-4d2f-46c3-8a19-bcaf2f6e318f req-7b7437f5-d5f8-493f-ac50-1888890f458f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:04.489524 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7f606044-4d2f-46c3-8a19-bcaf2f6e318f req-7b7437f5-d5f8-493f-ac50-1888890f458f service neutron] 10.222.0.48 "GET /v2.0/subnets?id=6137ee10-ce13-45c9-8edb-31811502bfd7 HTTP/1.1" status: 200  len: 855 time: 0.0774684
Jun 01 06:16:04.494207 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:16:04.501332 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=7e398897-85c4-48cb-8059-cbb26d0f11bb,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:04.502055 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Usage tracker for resource:floatingip and tenant:ac4006667c3442a3910d548e9e9d22c0 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:16:04.504559 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:04.510792 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:16:04.519389 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] Set router 4b9daac3-8875-4acd-af69-09a389effcf9 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:16:04.520911 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:16:04.533221 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for floatingip, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:04.706420 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:04.887749 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_common [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Allocated IP 172.27.2.47 (83b812fb-2cfc-46e4-baa4-745218ea3ed2/a59d7d11-a92c-4b4f-83cf-2095ecee2b51/91cf9071-1416-48a2-a730-f59d369efb5b) {{(pid=92230) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:16:04.888454 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b285d760>, [{'id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'name': 'tempest-TestMinimumBasicScenario-2100526911-router', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54'}], 'enable_snat': True}, 'gw_port_id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:15:55Z', 'updated_at': '2021-06-01T06:16:02Z', 'revision_number': 4, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'gw_port': {'id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:16:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:15:56Z', 'updated_at': '2021-06-01T06:16:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': 'ac9595c2-fb73-47ad-a4a7-a8318ad01d8c', 'name': '', 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'mac_address': 'fa:16:3e:a7:87:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'device_owner': 'network:router_interface', 'standard_attr_id': 537, 'fixed_ips': [{'subnet_id': '27e7a9e0-ab4e-478c-aff2-55a26159dc84', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:16:01Z', 'updated_at': '2021-06-01T06:16:03Z', 'revision_number': 2, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'subnets': [{'id': '27e7a9e0-ab4e-478c-aff2-55a26159dc84', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:04.892963 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] Checking router: 4b9daac3-8875-4acd-af69-09a389effcf9 for host: dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:16:04.893315 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] Updating router 4b9daac3-8875-4acd-af69-09a389effcf9 port ac9595c2-fb73-47ad-a4a7-a8318ad01d8c binding host dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 06:16:04.907851 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4707869b-49de-404a-95e6-1e87fe9ba1db req-49bd1b54-7d8a-4bea-b0b6-e4a0685a44e0 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:04.909412 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4707869b-49de-404a-95e6-1e87fe9ba1db req-49bd1b54-7d8a-4bea-b0b6-e4a0685a44e0 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 943 time: 0.2077079
Jun 01 06:16:04.960908 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:04.962639 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4707869b-49de-404a-95e6-1e87fe9ba1db req-7e9de020-2e54-41ad-b3ef-4069df33e9ea tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0452373
Jun 01 06:16:04.976001 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 37958) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:16:04.984304 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-99861397-network', 'tenant_id': '43f56027f58d47f5b11d46a512f3e137'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:16:04.989310 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:16:04.993245 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Usage tracker for resource:network and tenant:43f56027f58d47f5b11d46a512f3e137 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:16:04.996997 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:16:05.002882 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:16:05.017005 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Made reservation on behalf of 43f56027f58d47f5b11d46a512f3e137 for: {'network': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:16:05.019428 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-8110114'] for network, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:05.034095 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:05.048900 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:16:05.052991 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Usage tracker for resource:security_group_rule and tenant:43f56027f58d47f5b11d46a512f3e137 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:16:05.056593 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:16:05.063071 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:16:05.083988 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for port, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:05.117631 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:05.122895 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-123c775d-bcb1-401a-8d59-e94d0f1fdc0f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:05.164656 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:05.169095 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:05.172931 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-263821f5-27ee-4e64-822d-c322c3e6fc34 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:05.185323 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:16:05.188261 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:16:05.191841 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Received port after_create {{(pid=92230) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:16:05.208925 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] vlan segment allocate from pool success with {'vlan_id': 205, 'physical_network': 'physnet1'}  {{(pid=92229) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 06:16:05.218062 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=928b09ab-dc11-4d86-ab5b-b0f3261d42a0,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:05.222230 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:05.224749 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:05.225078 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Pushing event updated for resources: {'Port': ['ID=91cf9071-1416-48a2-a730-f59d369efb5b,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:05.225206 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.db.segments_db [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Added segment 7f505287-cd09-4e79-b15f-b1cfa1fb5101 of type vlan for network a62a4246-c7f6-49f1-8116-df3533b6b298
Jun 01 06:16:05.229538 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:05.254299 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8788496565589'] for network, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:05.283148 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:05.292879 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104'] for network, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:05.332415 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:05.333055 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:05.358726 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:05.360122 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:05.390483 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 886 time: 0.4105177
Jun 01 06:16:05.390690 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] Notify callbacks [] for port, precommit_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:05.393196 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 37964) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:16:05.404123 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.provisioning_blocks [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] Transition to ACTIVE for port object ac9595c2-fb73-47ad-a4a7-a8318ad01d8c will not be triggered until provisioned by entity L2. {{(pid=92232) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:16:05.405826 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-c1734292-eeb1-4fe3-8274-b00774aaa5be admin admin] Request body: {'subnet': {'network_id': 'a62a4246-c7f6-49f1-8116-df3533b6b298', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-99861397-subnet', 'tenant_id': '43f56027f58d47f5b11d46a512f3e137', 'ip_version': 4}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:16:05.412316 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:05.413910 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-c1734292-eeb1-4fe3-8274-b00774aaa5be admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:16:05.417512 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:05.421452 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-c1734292-eeb1-4fe3-8274-b00774aaa5be admin admin] Usage tracker for resource:subnet and tenant:43f56027f58d47f5b11d46a512f3e137 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:16:05.425450 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-c1734292-eeb1-4fe3-8274-b00774aaa5be admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:16:05.437665 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-c1734292-eeb1-4fe3-8274-b00774aaa5be admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:16:05.469428 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c1734292-eeb1-4fe3-8274-b00774aaa5be admin admin] Made reservation on behalf of 43f56027f58d47f5b11d46a512f3e137 for: {'subnet': 1} {{(pid=92230) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:16:05.471688 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-c1734292-eeb1-4fe3-8274-b00774aaa5be admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1981512'] for subnet, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:05.477450 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Pushing event updated for resources: {'Network': ['ID=a62a4246-c7f6-49f1-8116-df3533b6b298,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:05.480313 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-93dd0a9a-7a13-48b1-aa14-af95182c6413 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:05.491005 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f606044-4d2f-46c3-8a19-bcaf2f6e318f req-e9366cbf-b841-41f0-88ed-cbaf02242ea7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:05.492535 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7f606044-4d2f-46c3-8a19-bcaf2f6e318f req-e9366cbf-b841-41f0-88ed-cbaf02242ea7 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=5f973ed4-521b-4b78-9a54-1336b1302fa2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1984360
Jun 01 06:16:05.498132 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Network a62a4246-c7f6-49f1-8116-df3533b6b298 details requested by agent ovs-agent-dv-cinder-793885-1-iscsi with host dv-cinder-793885-1-iscsi {{(pid=92231) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 06:16:05.576028 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7351dfb7-c8d6-414d-becc-2b859eb706a8 None None] Pushing event updated for resources: {'Port': ['ID=ac9595c2-fb73-47ad-a4a7-a8318ad01d8c,revision_number=3']} {{(pid=92232) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:05.578996 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-7351dfb7-c8d6-414d-becc-2b859eb706a8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:05.677515 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] Attempting to bind port ac9595c2-fb73-47ad-a4a7-a8318ad01d8c on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:16:05.678187 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] Attempting to bind port ac9595c2-fb73-47ad-a4a7-a8318ad01d8c by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': 'c40d74a4-eecc-4c63-8fd5-38ee39e77ccd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 221, 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8'}] {{(pid=92232) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:16:05.678319 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] Attempting to bind port ac9595c2-fb73-47ad-a4a7-a8318ad01d8c on network d36c4486-6b2d-4439-996b-f13c04a98cb8 {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:16:05.685893 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 15, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:16:05.686241 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] Checking segment: {'id': 'c40d74a4-eecc-4c63-8fd5-38ee39e77ccd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 221, 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92232) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:16:05.686719 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:05.687027 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] Bound using segment: {'id': 'c40d74a4-eecc-4c63-8fd5-38ee39e77ccd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 221, 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8'} {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:16:05.687513 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] Bound port: ac9595c2-fb73-47ad-a4a7-a8318ad01d8c, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c40d74a4-eecc-4c63-8fd5-38ee39e77ccd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 221, 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8'}}] {{(pid=92232) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:16:05.687897 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:05.740723 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for port, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:05.749340 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2416196'] for port, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:05.756370 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:05.782666 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.db [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] For port ac9595c2-fb73-47ad-a4a7-a8318ad01d8c, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92232) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:16:05.786098 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.db [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] For port ac9595c2-fb73-47ad-a4a7-a8318ad01d8c, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=ac9595c2-fb73-47ad-a4a7-a8318ad01d8c,segment=NetworkSegment(c40d74a4-eecc-4c63-8fd5-38ee39e77ccd),segment_id=c40d74a4-eecc-4c63-8fd5-38ee39e77ccd)] {{(pid=92232) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:16:05.789857 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:05.794775 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:05.880407 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] Routers {'4b9daac3-8875-4acd-af69-09a389effcf9'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:16:05.881049 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b285d760>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:15:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['4b9daac3-8875-4acd-af69-09a389effcf9'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:05.946052 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7351dfb7-c8d6-414d-becc-2b859eb706a8 None None] Pushing event updated for resources: {'Port': ['ID=ac9595c2-fb73-47ad-a4a7-a8318ad01d8c,revision_number=4']} {{(pid=92232) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:05.951690 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-7351dfb7-c8d6-414d-becc-2b859eb706a8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:06.005219 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Pushing event updated for resources: {'Port': ['ID=91cf9071-1416-48a2-a730-f59d369efb5b,revision_number=2']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:06.020168 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.264s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:06.055623 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-745720'] for floatingip, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:06.110016 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for floatingip, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:06.118950 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 692 time: 1.6347985
Jun 01 06:16:06.131397 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] Set router 4b9daac3-8875-4acd-af69-09a389effcf9 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:16:06.161801 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 7e398897-85c4-48cb-8059-cbb26d0f11bb up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:16:06.291896 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 7e398897-85c4-48cb-8059-cbb26d0f11bb triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:16:06.292503 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:06.387173 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-c1734292-eeb1-4fe3-8274-b00774aaa5be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2445565', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1981534'] for subnet, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:06.392106 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:06.476119 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a1c8003-cada-4e0c-93ae-e7746069648c req-2163aa53-848e-410d-9b81-2b06b6022b49 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:06.478869 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1a1c8003-cada-4e0c-93ae-e7746069648c req-2163aa53-848e-410d-9b81-2b06b6022b49 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 943 time: 0.3057606
Jun 01 06:16:06.485073 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1734292-eeb1-4fe3-8274-b00774aaa5be admin admin] Pushing event updated for resources: {'Subnet': ['ID=c9393913-0a82-467c-b1f7-1525ee7c2eb7,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:06.489437 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-c1734292-eeb1-4fe3-8274-b00774aaa5be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:06.497107 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1734292-eeb1-4fe3-8274-b00774aaa5be admin admin] Checking segment: {'id': '7f505287-cd09-4e79-b15f-b1cfa1fb5101', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 205, 'network_id': 'a62a4246-c7f6-49f1-8116-df3533b6b298'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92230) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:16:06.497466 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1734292-eeb1-4fe3-8274-b00774aaa5be admin admin] Network hostable DHCP agents. Network: a62a4246-c7f6-49f1-8116-df3533b6b298, hostable agents: ['648832f0-f26e-4e29-ac0d-d97e4a75c6c4'], hosted agents: [] {{(pid=92230) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 06:16:06.521043 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1734292-eeb1-4fe3-8274-b00774aaa5be admin admin] Network a62a4246-c7f6-49f1-8116-df3533b6b298 is scheduled to be hosted by DHCP agent 648832f0-f26e-4e29-ac0d-d97e4a75c6c4 with binding_index 1 {{(pid=92230) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 06:16:06.536678 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-c1734292-eeb1-4fe3-8274-b00774aaa5be admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793885-1-iscsi, a62a4246-c7f6-49f1-8116-df3533b6b298) {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:16:06.547918 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-94eb5ecc-9479-4b46-b27c-b390cb72b9b3 None None] Network a62a4246-c7f6-49f1-8116-df3533b6b298 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:16:06.551867 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1734292-eeb1-4fe3-8274-b00774aaa5be admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:06.553106 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-c1734292-eeb1-4fe3-8274-b00774aaa5be admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:06.575693 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b285d760>, [{'id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'name': 'tempest-TestMinimumBasicScenario-2100526911-router', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54'}], 'enable_snat': True}, 'gw_port_id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:15:55Z', 'updated_at': '2021-06-01T06:16:02Z', 'revision_number': 4, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'gw_port': {'id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:16:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:15:56Z', 'updated_at': '2021-06-01T06:16:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': 'ac9595c2-fb73-47ad-a4a7-a8318ad01d8c', 'name': '', 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'mac_address': 'fa:16:3e:a7:87:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'device_owner': 'network:router_interface', 'standard_attr_id': 537, 'fixed_ips': [{'subnet_id': '27e7a9e0-ab4e-478c-aff2-55a26159dc84', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:16:01Z', 'updated_at': '2021-06-01T06:16:05Z', 'revision_number': 4, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'subnets': [{'id': '27e7a9e0-ab4e-478c-aff2-55a26159dc84', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:06.581480 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77caec1e-01d5-43a7-aed3-57314315bf7b None None] The sync data for ids ['4b9daac3-8875-4acd-af69-09a389effcf9'] in dv-cinder-793885-1-iscsi is: [{'id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'name': 'tempest-TestMinimumBasicScenario-2100526911-router', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54'}], 'enable_snat': True}, 'gw_port_id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:15:55Z', 'updated_at': '2021-06-01T06:16:02Z', 'revision_number': 4, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'gw_port': {'id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:16:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:15:56Z', 'updated_at': '2021-06-01T06:16:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': 'ac9595c2-fb73-47ad-a4a7-a8318ad01d8c', 'name': '', 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'mac_address': 'fa:16:3e:a7:87:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'device_owner': 'network:router_interface', 'standard_attr_id': 537, 'fixed_ips': [{'subnet_id': '27e7a9e0-ab4e-478c-aff2-55a26159dc84', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:16:01Z', 'updated_at': '2021-06-01T06:16:05Z', 'revision_number': 4, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'subnets': [{'id': '27e7a9e0-ab4e-478c-aff2-55a26159dc84', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:16:06.587892 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 37984) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:16:06.591107 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-c1734292-eeb1-4fe3-8274-b00774aaa5be admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 849 time: 1.1968019
Jun 01 06:16:06.617909 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-99861397-router', 'tenant_id': '43f56027f58d47f5b11d46a512f3e137', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:16:06.625718 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-1feeb22d-f76e-44d5-9b97-f265f286fa4f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Synchronizing usage tracker for tenant:ac4006667c3442a3910d548e9e9d22c0 on resource:security_group {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:16:06.660737 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1a1c8003-cada-4e0c-93ae-e7746069648c req-dbc396a7-90e8-4cb5-8d0d-31715dd53384 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1530163
Jun 01 06:16:06.661590 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:16:06.690706 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7f606044-4d2f-46c3-8a19-bcaf2f6e318f req-ae4a6fef-0e7b-4935-bba2-75a07723cae6 service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4081051
Jun 01 06:16:06.691672 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Usage tracker for resource:router and tenant:43f56027f58d47f5b11d46a512f3e137 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:16:06.695701 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:16:06.733383 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:16:06.746915 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-1feeb22d-f76e-44d5-9b97-f265f286fa4f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Unset dirty status for tenant:ac4006667c3442a3910d548e9e9d22c0 on resource:security_group {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:16:06.748148 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-1feeb22d-f76e-44d5-9b97-f265f286fa4f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-securitygroup--2001095692&fields=id&tenant_id=ac4006667c3442a3910d548e9e9d22c0 HTTP/1.1" status: 200  len: 267 time: 0.2842722
Jun 01 06:16:06.836071 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-748217', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-677'] for router, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:06.837652 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-749241', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-745574', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-726667', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-686'] for router, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:06.850500 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp5012ce77-b332-5f05-8982-a48a8fc8d50e-a62a4246-c7f6-49f1-8116-df3533b6b298', 'network_id': 'a62a4246-c7f6-49f1-8116-df3533b6b298', 'tenant_id': '43f56027f58d47f5b11d46a512f3e137', 'fixed_ips': [{'subnet_id': 'c9393913-0a82-467c-b1f7-1525ee7c2eb7'}]}} from dv-cinder-793885-1-iscsi. {{(pid=92231) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 06:16:06.851442 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:07.000501 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:07.046218 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7f606044-4d2f-46c3-8a19-bcaf2f6e318f req-d04858ba-3b7a-4de3-b966-03ba37391b39 service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3440137
Jun 01 06:16:07.068449 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.db_base_plugin_common [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Allocated IP 172.20.0.2 (a62a4246-c7f6-49f1-8116-df3533b6b298/c9393913-0a82-467c-b1f7-1525ee7c2eb7/81d48392-f948-43df-923d-bb60ae00642d) {{(pid=92231) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:16:07.079305 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-35456521-8716-4cf2-828f-870fab127e61 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:07.080833 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-35456521-8716-4cf2-828f-870fab127e61 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/networks?id=0890ab9c-2266-4ef4-af73-d3ff421b9bd7 HTTP/1.1" status: 200  len: 811 time: 0.2736742
Jun 01 06:16:07.164479 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-9bda98e9-a9f0-4902-9307-faa9cc04a597 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/quotas/ac4006667c3442a3910d548e9e9d22c0 HTTP/1.1" status: 200  len: 375 time: 0.0154955
Jun 01 06:16:07.331685 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Notify callbacks [] for port, precommit_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:07.345874 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Transition to ACTIVE for port object 81d48392-f948-43df-923d-bb60ae00642d will not be triggered until provisioned by entity L2. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:16:07.369355 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Transition to ACTIVE for port object 81d48392-f948-43df-923d-bb60ae00642d will not be triggered until provisioned by entity DHCP. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:16:07.375622 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747'] for port, after_create {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:07.380877 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-7007a856-a4dc-436c-8864-62f358f28431 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:07.446427 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-745539', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-748171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-728'] for router, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:07.447184 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Network a62a4246-c7f6-49f1-8116-df3533b6b298 is already hosted by enough agents. {{(pid=92231) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:16:07.456054 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.scheduler.base_scheduler [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Resources bound (agent type, host, resource id):  {{(pid=92231) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:16:07.458703 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Received port after_create {{(pid=92231) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:16:07.489890 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-d5610a82-65f0-47f7-9912-b2b3100e65e2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=ac4006667c3442a3910d548e9e9d22c0&fields=id HTTP/1.1" status: 200  len: 348 time: 0.2502666
Jun 01 06:16:07.557792 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Pushing event updated for resources: {'Port': ['ID=81d48392-f948-43df-923d-bb60ae00642d,revision_number=1']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:07.561089 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.180s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:07.582766 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Attempting to bind port 81d48392-f948-43df-923d-bb60ae00642d on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:16:07.583199 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Attempting to bind port 81d48392-f948-43df-923d-bb60ae00642d by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': '7f505287-cd09-4e79-b15f-b1cfa1fb5101', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 205, 'network_id': 'a62a4246-c7f6-49f1-8116-df3533b6b298'}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:16:07.583644 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Attempting to bind port 81d48392-f948-43df-923d-bb60ae00642d on network a62a4246-c7f6-49f1-8116-df3533b6b298 {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:16:07.591113 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 15, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:16:07.592356 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Checking segment: {'id': '7f505287-cd09-4e79-b15f-b1cfa1fb5101', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 205, 'network_id': 'a62a4246-c7f6-49f1-8116-df3533b6b298'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92231) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:16:07.592796 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:07.593211 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Bound using segment: {'id': '7f505287-cd09-4e79-b15f-b1cfa1fb5101', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 205, 'network_id': 'a62a4246-c7f6-49f1-8116-df3533b6b298'} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:16:07.593906 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Bound port: 81d48392-f948-43df-923d-bb60ae00642d, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7f505287-cd09-4e79-b15f-b1cfa1fb5101', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 205, 'network_id': 'a62a4246-c7f6-49f1-8116-df3533b6b298'}}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:16:07.594323 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:07.737114 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] For port 81d48392-f948-43df-923d-bb60ae00642d, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92231) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:16:07.742695 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] For port 81d48392-f948-43df-923d-bb60ae00642d, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=81d48392-f948-43df-923d-bb60ae00642d,segment=NetworkSegment(7f505287-cd09-4e79-b15f-b1cfa1fb5101),segment_id=7f505287-cd09-4e79-b15f-b1cfa1fb5101)] {{(pid=92231) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:16:07.760149 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:07.764794 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:07.926415 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Pushing event updated for resources: {'Port': ['ID=81d48392-f948-43df-923d-bb60ae00642d,revision_number=2']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:07.930065 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:07.939381 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-2585732b-42ba-4bb1-8ffe-e8b65c00ac3f service neutron] 10.222.0.25 "GET /v2.0/networks/0890ab9c-2266-4ef4-af73-d3ff421b9bd7?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3959403
Jun 01 06:16:08.199361 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device ac9595c2-fb73-47ad-a4a7-a8318ad01d8c up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:16:08.329106 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2d7b91d-8537-49f2-b2af-47fcb795ec7a req-b561ba02-3742-4cc2-85d4-3b96ae6ed2a0 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:08.342702 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b2d7b91d-8537-49f2-b2af-47fcb795ec7a req-b561ba02-3742-4cc2-85d4-3b96ae6ed2a0 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 943 time: 0.4796226
Jun 01 06:16:08.352321 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-de5036c8-55df-4bc0-8e39-23f682eb2bcf service neutron] 10.222.0.25 "GET /v2.0/networks/0890ab9c-2266-4ef4-af73-d3ff421b9bd7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3917670
Jun 01 06:16:08.398312 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-54d87239-253e-41ab-8805-40af6ecf57d4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:08.401465 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port ac9595c2-fb73-47ad-a4a7-a8318ad01d8c completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:16:08.420228 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port ac9595c2-fb73-47ad-a4a7-a8318ad01d8c triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:16:08.420673 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:08.592903 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b2d7b91d-8537-49f2-b2af-47fcb795ec7a req-9cbc9018-4975-4c22-8ba5-6913aa3342b8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2374470
Jun 01 06:16:08.652203 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:08.695284 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-39010449-e9d2-46fe-bf2d-ae6d58fbe9d6 req-c29d13f5-46cb-454c-b7ce-ba630cef708e tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=99254438-3376-4397-ae41-1667e451ba6e HTTP/1.1" status: 200  len: 210 time: 0.0857739
Jun 01 06:16:08.715917 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port ac9595c2-fb73-47ad-a4a7-a8318ad01d8c, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=ac9595c2-fb73-47ad-a4a7-a8318ad01d8c,segment=NetworkSegment(c40d74a4-eecc-4c63-8fd5-38ee39e77ccd),segment_id=c40d74a4-eecc-4c63-8fd5-38ee39e77ccd)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:16:08.721968 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:08.724177 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:08.731000 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:08.768598 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:08.824687 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=ac9595c2-fb73-47ad-a4a7-a8318ad01d8c,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:08.835934 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:08.930020 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Allocated IP 172.27.2.188 (83b812fb-2cfc-46e4-baa4-745218ea3ed2/a59d7d11-a92c-4b4f-83cf-2095ecee2b51/2f756d86-5bac-4927-ae20-b147143147c2) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:16:09.177451 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:09.215356 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:09.220619 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:09.288982 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:16:09.293596 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:16:09.297528 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:16:09.342999 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Pushing event updated for resources: {'Port': ['ID=2f756d86-5bac-4927-ae20-b147143147c2,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:09.351655 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:09.358346 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c472798d-e710-4d1a-8350-b5d407bfc154 None None] Network a62a4246-c7f6-49f1-8116-df3533b6b298 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:16:09.455303 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-834fc88a-c5c4-45c8-a7fb-11bbd4bb7fdc None None] Provisioning for port 81d48392-f948-43df-923d-bb60ae00642d completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:16:09.935501 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:10.072608 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3a734e48-d249-4f09-98c2-05c9ec53ebdf req-e686624b-6eee-4001-bd9e-51987e1a510c tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=99254438-3376-4397-ae41-1667e451ba6e HTTP/1.1" status: 200  len: 210 time: 0.1511881
Jun 01 06:16:10.247925 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 81d48392-f948-43df-923d-bb60ae00642d up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:16:10.320564 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:16:10.335815 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1663903-5db8-405a-a5e9-eeeb3b17a093 req-aec24907-19cd-41fa-b307-b632d24e3fee tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:10.338126 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d1663903-5db8-405a-a5e9-eeeb3b17a093 req-aec24907-19cd-41fa-b307-b632d24e3fee tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 943 time: 0.5606515
Jun 01 06:16:10.346887 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-fa035bff-3562-4802-a4fa-d80b60cf1848 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:10.348393 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-fa035bff-3562-4802-a4fa-d80b60cf1848 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.48 "GET /v2.0/networks?id=0890ab9c-2266-4ef4-af73-d3ff421b9bd7 HTTP/1.1" status: 200  len: 811 time: 0.4142570
Jun 01 06:16:10.442889 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port 81d48392-f948-43df-923d-bb60ae00642d completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:16:10.451515 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 81d48392-f948-43df-923d-bb60ae00642d triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:16:10.451928 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:10.565689 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=3a7e88d5-0834-4e15-acbc-90cd1b9bca61,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:16:10.595871 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-82a47bf4-7272-4409-a103-ce6f199d0bae tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.48 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ac4006667c3442a3910d548e9e9d22c0 HTTP/1.1" status: 200  len: 380 time: 0.1881766
Jun 01 06:16:10.598619 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d1663903-5db8-405a-a5e9-eeeb3b17a093 req-24a53556-be0d-4de3-a19c-7cd9389f2dea tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1898792
Jun 01 06:16:10.605926 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-d792ce61-211d-49c8-a551-9165be8bb274 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Request body: {'port': {'device_id': '99254438-3376-4397-ae41-1667e451ba6e', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'admin_state_up': True, 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'security_groups': ['7b7f5fd5-de63-4478-8c7a-1d742b2fa2da']}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:16:10.616527 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'port_id': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61', 'mac_address': 'fa:16:3e:84:9b:48', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 245, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:16:10.695633 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:10.704978 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-748208', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-745472'] for router, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:10.725712 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:10.752035 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:16:10.759178 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port 81d48392-f948-43df-923d-bb60ae00642d, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=81d48392-f948-43df-923d-bb60ae00642d,segment=NetworkSegment(7f505287-cd09-4e79-b15f-b1cfa1fb5101),segment_id=7f505287-cd09-4e79-b15f-b1cfa1fb5101)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:16:10.767033 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:10.767894 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device ac9595c2-fb73-47ad-a4a7-a8318ad01d8c up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:16:10.801643 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:10.866962 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=3a7e88d5-0834-4e15-acbc-90cd1b9bca61,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:16:10.878018 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:10.904068 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=81d48392-f948-43df-923d-bb60ae00642d,revision_number=3']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:10.907507 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:10.907994 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.023s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:10.931227 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-d792ce61-211d-49c8-a551-9165be8bb274 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:16:10.939136 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-d792ce61-211d-49c8-a551-9165be8bb274 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Usage tracker for resource:port and tenant:ac4006667c3442a3910d548e9e9d22c0 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:16:10.943440 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-d792ce61-211d-49c8-a551-9165be8bb274 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Quota usage for port was recalculated. Used quota:3. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:16:10.954416 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-d792ce61-211d-49c8-a551-9165be8bb274 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:16:10.975859 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-d792ce61-211d-49c8-a551-9165be8bb274 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Made reservation on behalf of ac4006667c3442a3910d548e9e9d22c0 for: {'port': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:16:10.977966 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port ac9595c2-fb73-47ad-a4a7-a8318ad01d8c triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:16:10.978345 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:10.979463 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-d792ce61-211d-49c8-a551-9165be8bb274 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:11.040765 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=3a7e88d5-0834-4e15-acbc-90cd1b9bca61,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:11.045355 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:11.077648 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Router 5259b64a-6ad9-47e2-a600-f8c700202c34 is scheduled to L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 with binding_index 1 {{(pid=92229) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 06:16:11.112642 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['3a7e88d5-0834-4e15-acbc-90cd1b9bca61'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:16:11.232510 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:11.277746 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b493109a-5473-42a7-8fbe-2eee003a0fc4 req-aa3a357e-3a8e-4a7a-9626-684d4bdf6eac tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=99254438-3376-4397-ae41-1667e451ba6e HTTP/1.1" status: 200  len: 210 time: 0.0706024
Jun 01 06:16:11.471068 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-d792ce61-211d-49c8-a551-9165be8bb274 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Allocated IP 172.20.0.6 (0890ab9c-2266-4ef4-af73-d3ff421b9bd7/3e980239-de35-45a0-8039-8395b5408617/71f9d0f0-891d-4ab3-93a2-6ace16cac0a9) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:16:11.493627 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92229) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:16:11.502541 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] Sync routers for ids ['5259b64a-6ad9-47e2-a600-f8c700202c34'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:16:11.512541 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] Routers {'5259b64a-6ad9-47e2-a600-f8c700202c34'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:16:11.513239 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b23353d0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:15:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['5259b64a-6ad9-47e2-a600-f8c700202c34'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:11.616842 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Notify callbacks [] for router, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:11.619895 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] 10.222.0.25 "POST /v2.0/routers HTTP/1.1" status: 201  len: 925 time: 5.0232232
Jun 01 06:16:11.621663 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 38040) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:16:11.747916 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-d792ce61-211d-49c8-a551-9165be8bb274 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:11.767284 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] Set router 5259b64a-6ad9-47e2-a600-f8c700202c34 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:16:11.823505 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-d792ce61-211d-49c8-a551-9165be8bb274 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Transition to ACTIVE for port object 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 will not be triggered until provisioned by entity DHCP. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:16:11.884672 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcb79adb-ec1f-4e98-9f85-82e69813c414 req-3023b38b-8827-4b31-9d15-e073f37ce982 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:11.886589 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fcb79adb-ec1f-4e98-9f85-82e69813c414 req-3023b38b-8827-4b31-9d15-e073f37ce982 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 944 time: 0.1089938
Jun 01 06:16:11.888179 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-d792ce61-211d-49c8-a551-9165be8bb274 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:11.893777 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:11.992543 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-d792ce61-211d-49c8-a551-9165be8bb274 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Network 0890ab9c-2266-4ef4-af73-d3ff421b9bd7 is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:16:11.997913 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-d792ce61-211d-49c8-a551-9165be8bb274 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:16:12.005422 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-d792ce61-211d-49c8-a551-9165be8bb274 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:16:12.035400 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d792ce61-211d-49c8-a551-9165be8bb274 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Pushing event updated for resources: {'Port': ['ID=71f9d0f0-891d-4ab3-93a2-6ace16cac0a9,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:12.047590 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-d792ce61-211d-49c8-a551-9165be8bb274 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:12.054764 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fcb79adb-ec1f-4e98-9f85-82e69813c414 req-a5726763-238f-4ae5-b9bf-78973e17ba81 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1257615
Jun 01 06:16:12.096619 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-d792ce61-211d-49c8-a551-9165be8bb274 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:12.097254 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-d792ce61-211d-49c8-a551-9165be8bb274 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:12.124777 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b23353d0>, [{'id': '5259b64a-6ad9-47e2-a600-f8c700202c34', 'name': 'tempest-TestMinimumBasicScenario-99861397-router', 'tenant_id': '43f56027f58d47f5b11d46a512f3e137', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.188'}], 'enable_snat': True}, 'gw_port_id': '2f756d86-5bac-4927-ae20-b147143147c2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:16:06Z', 'updated_at': '2021-06-01T06:16:09Z', 'revision_number': 3, 'project_id': '43f56027f58d47f5b11d46a512f3e137', 'gw_port': {'id': '2f756d86-5bac-4927-ae20-b147143147c2', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:67:ce', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5259b64a-6ad9-47e2-a600-f8c700202c34', 'device_owner': 'network:router_gateway', 'standard_attr_id': 555, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:16:08Z', 'updated_at': '2021-06-01T06:16:08Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:12.128840 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-d792ce61-211d-49c8-a551-9165be8bb274 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.5271342
Jun 01 06:16:12.132924 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] Checking router: 5259b64a-6ad9-47e2-a600-f8c700202c34 for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:16:12.133380 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] Updating router 5259b64a-6ad9-47e2-a600-f8c700202c34 port 2f756d86-5bac-4927-ae20-b147143147c2 binding host dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 06:16:12.149037 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Request body: {'port': {'device_id': '99254438-3376-4397-ae41-1667e451ba6e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79388'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:16:12.183569 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 81d48392-f948-43df-923d-bb60ae00642d up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:16:12.255910 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:12.313872 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:16:12.327607 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:12.488184 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-561a8357-9abf-4878-a2c2-92d1f3d46081 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:12.490972 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-705d1e1e-5597-4137-b43f-611d07ab7253 None None] Provisioning for port 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:16:12.503334 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 81d48392-f948-43df-923d-bb60ae00642d triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:16:12.504066 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:12.549802 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-705d1e1e-5597-4137-b43f-611d07ab7253 None None] Provisioning complete for port 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:16:12.550248 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-705d1e1e-5597-4137-b43f-611d07ab7253 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:12.579727 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ff335e30-78e2-44f9-9d7e-5c7401f9eacb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:12.635558 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning for port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:16:12.663262 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bc2cc96-bab4-42c3-837d-b2807c1878f5 req-1a589290-decb-4cd6-aeb2-5eae43019660 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:12.664044 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-0bc2cc96-bab4-42c3-837d-b2807c1878f5 req-1a589290-decb-4cd6-aeb2-5eae43019660 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Synchronizing usage tracker for tenant:ac4006667c3442a3910d548e9e9d22c0 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:16:12.704535 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:16:12.704936 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:12.711480 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-0bc2cc96-bab4-42c3-837d-b2807c1878f5 req-1a589290-decb-4cd6-aeb2-5eae43019660 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Unset dirty status for tenant:ac4006667c3442a3910d548e9e9d22c0 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:16:12.712774 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0bc2cc96-bab4-42c3-837d-b2807c1878f5 req-1a589290-decb-4cd6-aeb2-5eae43019660 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=99254438-3376-4397-ae41-1667e451ba6e HTTP/1.1" status: 200  len: 931 time: 0.2753808
Jun 01 06:16:12.756079 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-705d1e1e-5597-4137-b43f-611d07ab7253 None None] Port 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:16:12.777973 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0bc2cc96-bab4-42c3-837d-b2807c1878f5 req-ecb9c6b4-5b79-4a8a-a129-b8ab7d78e5f1 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=7b7f5fd5-de63-4478-8c7a-1d742b2fa2da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0505056
Jun 01 06:16:12.853848 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_common [None req-ff335e30-78e2-44f9-9d7e-5c7401f9eacb admin admin] Allocated IP 172.20.0.1 (a62a4246-c7f6-49f1-8116-df3533b6b298/c9393913-0a82-467c-b1f7-1525ee7c2eb7/79a126cb-af44-4fd1-9f46-1de4e1ad9f55) {{(pid=92230) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:16:12.879008 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 {{(pid=92229) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:16:12.888073 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:12.905723 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Transition to ACTIVE for port object 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 will not be triggered until provisioned by entity L2. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:16:12.910796 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2077419'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:12.917278 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-320025e9-8be7-4a00-841e-052713bd1764 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:12.985686 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:13.065098 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0504a6b7-2f41-4914-a3bb-2f908556d658', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:16:13.067632 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e3b74e49-0d27-4cfd-b96e-8038b26a3253" -d '{"events": [{"server_uuid": "0504a6b7-2f41-4914-a3bb-2f908556d658", "name": "network-vif-plugged", "status": "completed", "tag": "3a7e88d5-0834-4e15-acbc-90cd1b9bca61"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:16:13.103079 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] Notify callbacks [] for port, precommit_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:13.116230 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=3a7e88d5-0834-4e15-acbc-90cd1b9bca61,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:16:13.126291 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Pushing event updated for resources: {'Port': ['ID=71f9d0f0-891d-4ab3-93a2-6ace16cac0a9,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:13.133448 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.216s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:13.135628 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:13.148356 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ff335e30-78e2-44f9-9d7e-5c7401f9eacb admin admin] Notify callbacks [] for port, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:13.150605 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:13.188274 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.provisioning_blocks [None req-ff335e30-78e2-44f9-9d7e-5c7401f9eacb admin admin] Transition to ACTIVE for port object 79a126cb-af44-4fd1-9f46-1de4e1ad9f55 will not be triggered until provisioned by entity DHCP. {{(pid=92230) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:16:13.198039 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:16:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ae864a2b-14ff-47b2-bf37-a91bb0497908 x-openstack-request-id: req-ae864a2b-14ff-47b2-bf37-a91bb0497908 {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:16:13.198603 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0504a6b7-2f41-4914-a3bb-2f908556d658", "name": "network-vif-plugged", "status": "completed", "tag": "3a7e88d5-0834-4e15-acbc-90cd1b9bca61", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:16:13.199020 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-ae864a2b-14ff-47b2-bf37-a91bb0497908 {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:16:13.199685 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0504a6b7-2f41-4914-a3bb-2f908556d658', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61', 'code': 200}
Jun 01 06:16:13.209844 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] Transition to ACTIVE for port object 2f756d86-5bac-4927-ae20-b147143147c2 will not be triggered until provisioned by entity L2. {{(pid=92231) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:16:13.241298 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:13.248114 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ff335e30-78e2-44f9-9d7e-5c7401f9eacb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:13.253134 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-56c0c333-4b85-4ecb-bf0f-4afe5f4760a1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:13.296222 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Attempting to bind port 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 on host hv-cinder-79388 for vnic_type normal with profile  {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:16:13.296597 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Attempting to bind port 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 by drivers openvswitch,hyperv on host hv-cinder-79388 at level 0 using segments [{'id': '5dda6d07-db2a-40a3-815e-42df1528c630', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 224, 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7'}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:16:13.296935 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Attempting to bind port 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 on network 0890ab9c-2266-4ef4-af73-d3ff421b9bd7 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:16:13.311954 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Port 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 on network 0890ab9c-2266-4ef4-af73-d3ff421b9bd7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79388 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 06:16:13.312198 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Attempting to bind port 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 on network 0890ab9c-2266-4ef4-af73-d3ff421b9bd7 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:16:13.315639 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:13.318681 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=3a7e88d5-0834-4e15-acbc-90cd1b9bca61,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:13.323715 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:13.324652 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.069s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:13.394153 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Checking agent: {'id': '56148394-2131-4d06-bcfa-c032301591b8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79388', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'started_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 15, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:16:13.394492 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Checking segment: {'id': '5dda6d07-db2a-40a3-815e-42df1528c630', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 224, 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:16:13.394899 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Bound using segment: {'id': '5dda6d07-db2a-40a3-815e-42df1528c630', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 224, 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7'} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:16:13.395328 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Bound port: 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9, host: hv-cinder-79388, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5dda6d07-db2a-40a3-815e-42df1528c630', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 224, 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7'}}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:16:13.395677 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:13.404561 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] Attempting to bind port 2f756d86-5bac-4927-ae20-b147143147c2 on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:16:13.405100 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] Attempting to bind port 2f756d86-5bac-4927-ae20-b147143147c2 by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:16:13.405575 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] Attempting to bind port 2f756d86-5bac-4927-ae20-b147143147c2 on network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:16:13.412017 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-314174fd-c027-485f-84e5-d1cbcc7e71fb None None] Pushing event updated for resources: {'Port': ['ID=2f756d86-5bac-4927-ae20-b147143147c2,revision_number=2']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:13.416057 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-314174fd-c027-485f-84e5-d1cbcc7e71fb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:13.436892 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 16, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:16:13.437382 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] Checking segment: {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92231) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:16:13.437849 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:13.438438 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] Bound using segment: {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'} {{(pid=92231) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:16:13.439025 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.managers [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] Bound port: 2f756d86-5bac-4927-ae20-b147143147c2, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ad0428a0-0215-4be6-940c-57ddf2bfce55', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2'}}] {{(pid=92231) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:16:13.439459 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:13.501720 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff335e30-78e2-44f9-9d7e-5c7401f9eacb admin admin] Network a62a4246-c7f6-49f1-8116-df3533b6b298 is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:16:13.505426 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-ff335e30-78e2-44f9-9d7e-5c7401f9eacb admin admin] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:16:13.509539 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff335e30-78e2-44f9-9d7e-5c7401f9eacb admin admin] Received port after_create {{(pid=92230) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:16:13.542568 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c235e989-a8dd-4501-8c6b-ce12b381b574 req-7ee19887-d003-426d-a2b2-d2fc97cb67f0 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:13.544202 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c235e989-a8dd-4501-8c6b-ce12b381b574 req-7ee19887-d003-426d-a2b2-d2fc97cb67f0 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 945 time: 0.2334886
Jun 01 06:16:13.551329 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff335e30-78e2-44f9-9d7e-5c7401f9eacb admin admin] Pushing event updated for resources: {'Port': ['ID=79a126cb-af44-4fd1-9f46-1de4e1ad9f55,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:13.560589 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-ff335e30-78e2-44f9-9d7e-5c7401f9eacb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.307s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:13.570185 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] For port 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9, host hv-cinder-79388, cleared binding levels {{(pid=92229) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:16:13.578697 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] For port 2f756d86-5bac-4927-ae20-b147143147c2, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92231) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:16:13.579466 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] For port 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9, host hv-cinder-79388, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=71f9d0f0-891d-4ab3-93a2-6ace16cac0a9,segment=NetworkSegment(5dda6d07-db2a-40a3-815e-42df1528c630),segment_id=5dda6d07-db2a-40a3-815e-42df1528c630)] {{(pid=92229) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:16:13.583955 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] For port 2f756d86-5bac-4927-ae20-b147143147c2, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=2f756d86-5bac-4927-ae20-b147143147c2,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92231) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:16:13.588236 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ff335e30-78e2-44f9-9d7e-5c7401f9eacb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-744049'] for router_interface, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:13.594541 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:13.600324 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-ba87c287-7a9b-41b6-808d-2cdf978b4330 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:13.648221 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2077419'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:13.663390 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-aa2b47a7-1c07-4f7d-8df5-efdcc13b5f20 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:13.729860 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] Routers {'5259b64a-6ad9-47e2-a600-f8c700202c34'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:16:13.730139 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b23353d0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:16:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['5259b64a-6ad9-47e2-a600-f8c700202c34'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:13.791839 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:13.792514 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:13.795315 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] 10.222.0.48 "PUT /v2.0/ports/71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 HTTP/1.1" status: 200  len: 1093 time: 1.6549950
Jun 01 06:16:13.798150 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '99254438-3376-4397-ae41-1667e451ba6e', 'tag': '71f9d0f0-891d-4ab3-93a2-6ace16cac0a9'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:16:13.804062 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c107d915-b68f-4d6d-a7bf-ae5ce93ff5e5" -d '{"events": [{"name": "network-changed", "server_uuid": "99254438-3376-4397-ae41-1667e451ba6e", "tag": "71f9d0f0-891d-4ab3-93a2-6ace16cac0a9"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:16:13.815979 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ff335e30-78e2-44f9-9d7e-5c7401f9eacb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:13.862232 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c235e989-a8dd-4501-8c6b-ce12b381b574 req-dd334bce-d0a3-40d6-abe3-2a04540f6b94 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2439551
Jun 01 06:16:13.962870 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-314174fd-c027-485f-84e5-d1cbcc7e71fb None None] Pushing event updated for resources: {'Port': ['ID=2f756d86-5bac-4927-ae20-b147143147c2,revision_number=3']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:13.967214 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-314174fd-c027-485f-84e5-d1cbcc7e71fb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.367s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:13.991965 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-5b42e1ae-3c03-40b3-aaf9-1848e6c7fe75 None None] Provisioning for port 79a126cb-af44-4fd1-9f46-1de4e1ad9f55 completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:16:14.156000 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:16:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b1b1827a-1013-43fa-9bc3-5130bbf1ace3 x-openstack-request-id: req-b1b1827a-1013-43fa-9bc3-5130bbf1ace3 {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:16:14.156526 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "99254438-3376-4397-ae41-1667e451ba6e", "tag": "71f9d0f0-891d-4ab3-93a2-6ace16cac0a9", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:16:14.156633 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-b1b1827a-1013-43fa-9bc3-5130bbf1ace3 {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:16:14.157032 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '99254438-3376-4397-ae41-1667e451ba6e', 'tag': '71f9d0f0-891d-4ab3-93a2-6ace16cac0a9', 'status': 'completed', 'code': 200}
Jun 01 06:16:14.162992 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-5b42e1ae-3c03-40b3-aaf9-1848e6c7fe75 None None] Provisioning complete for port 79a126cb-af44-4fd1-9f46-1de4e1ad9f55 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:16:14.163659 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-5b42e1ae-3c03-40b3-aaf9-1848e6c7fe75 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:14.207522 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Pushing event updated for resources: {'Port': ['ID=71f9d0f0-891d-4ab3-93a2-6ace16cac0a9,revision_number=3']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:14.212755 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.549s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:14.222513 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ff335e30-78e2-44f9-9d7e-5c7401f9eacb admin admin] Notify callbacks [] for port, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:14.229849 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ff335e30-78e2-44f9-9d7e-5c7401f9eacb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2416196'] for port, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:14.251317 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33cd015d-40c3-4be4-ab77-fac86361ded0 req-d31a795b-038d-4033-8c0b-5e9997d91aa2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:14.252966 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-33cd015d-40c3-4be4-ab77-fac86361ded0 req-d31a795b-038d-4033-8c0b-5e9997d91aa2 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 1098 time: 0.7078733
Jun 01 06:16:14.261945 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-5b42e1ae-3c03-40b3-aaf9-1848e6c7fe75 None None] Port 79a126cb-af44-4fd1-9f46-1de4e1ad9f55 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:16:14.264050 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-66b9848e-5872-4450-ae07-5174eeb0ad02 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:14.275588 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] Set router 5259b64a-6ad9-47e2-a600-f8c700202c34 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:16:14.330559 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-33cd015d-40c3-4be4-ab77-fac86361ded0 req-429dad63-0fd4-4b33-95c5-ea0ae458ed0c service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0661392
Jun 01 06:16:14.341213 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-69c83fd5-bbf7-45fa-a9ca-e09459f70af4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:14.342916 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-69c83fd5-bbf7-45fa-a9ca-e09459f70af4 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=ac4006667c3442a3910d548e9e9d22c0&device_id=99254438-3376-4397-ae41-1667e451ba6e HTTP/1.1" status: 200  len: 1096 time: 0.4795773
Jun 01 06:16:14.351266 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b52b7a2-bdc4-4c3d-a2e2-a8c46524442d req-a5ad0a78-6c80-4bd8-a249-9e27fa923bf7 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:14.353498 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3b52b7a2-bdc4-4c3d-a2e2-a8c46524442d req-a5ad0a78-6c80-4bd8-a249-9e27fa923bf7 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=99254438-3376-4397-ae41-1667e451ba6e HTTP/1.1" status: 200  len: 943 time: 0.1900833
Jun 01 06:16:14.362880 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ff335e30-78e2-44f9-9d7e-5c7401f9eacb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-582666', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-744156'] for router_interface, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:14.367756 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff335e30-78e2-44f9-9d7e-5c7401f9eacb admin admin] Pushing event updated for resources: {'Port': ['ID=79a126cb-af44-4fd1-9f46-1de4e1ad9f55,revision_number=2']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:14.373987 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-ff335e30-78e2-44f9-9d7e-5c7401f9eacb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:14.482002 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-a96436b5-fefe-448e-9303-33e9f3d35f16 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 HTTP/1.1" status: 200  len: 217 time: 0.0908873
Jun 01 06:16:14.545397 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3b52b7a2-bdc4-4c3d-a2e2-a8c46524442d req-32e05b1d-8fa6-4c6d-a6a1-9537fa0a7d50 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=7b7f5fd5-de63-4478-8c7a-1d742b2fa2da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1848030
Jun 01 06:16:14.561276 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff335e30-78e2-44f9-9d7e-5c7401f9eacb admin admin] Network a62a4246-c7f6-49f1-8116-df3533b6b298 is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:16:14.570102 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-ff335e30-78e2-44f9-9d7e-5c7401f9eacb admin admin] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:16:14.600838 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-341480eb-8689-460f-be96-91d4ab29c064 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:14.603340 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-341480eb-8689-460f-be96-91d4ab29c064 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=3e980239-de35-45a0-8039-8395b5408617 HTTP/1.1" status: 200  len: 850 time: 0.1108022
Jun 01 06:16:14.720239 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-402a19e1-83ce-474f-a1d0-9e030afd0daf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:14.722403 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-402a19e1-83ce-474f-a1d0-9e030afd0daf service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=0890ab9c-2266-4ef4-af73-d3ff421b9bd7&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1126537
Jun 01 06:16:14.730345 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b23353d0>, [{'id': '5259b64a-6ad9-47e2-a600-f8c700202c34', 'name': 'tempest-TestMinimumBasicScenario-99861397-router', 'tenant_id': '43f56027f58d47f5b11d46a512f3e137', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.188'}], 'enable_snat': True}, 'gw_port_id': '2f756d86-5bac-4927-ae20-b147143147c2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:16:06Z', 'updated_at': '2021-06-01T06:16:13Z', 'revision_number': 4, 'project_id': '43f56027f58d47f5b11d46a512f3e137', 'gw_port': {'id': '2f756d86-5bac-4927-ae20-b147143147c2', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:67:ce', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5259b64a-6ad9-47e2-a600-f8c700202c34', 'device_owner': 'network:router_gateway', 'standard_attr_id': 555, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:16:08Z', 'updated_at': '2021-06-01T06:16:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '79a126cb-af44-4fd1-9f46-1de4e1ad9f55', 'name': '', 'network_id': 'a62a4246-c7f6-49f1-8116-df3533b6b298', 'tenant_id': '43f56027f58d47f5b11d46a512f3e137', 'mac_address': 'fa:16:3e:34:fe:85', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5259b64a-6ad9-47e2-a600-f8c700202c34', 'device_owner': 'network:router_interface', 'standard_attr_id': 557, 'fixed_ips': [{'subnet_id': 'c9393913-0a82-467c-b1f7-1525ee7c2eb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:16:12Z', 'updated_at': '2021-06-01T06:16:12Z', 'revision_number': 1, 'project_id': '43f56027f58d47f5b11d46a512f3e137', 'subnets': [{'id': 'c9393913-0a82-467c-b1f7-1525ee7c2eb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:14.735206 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87362d5c-7fec-498c-b0d9-352c7a34c80e None None] The sync data for ids ['5259b64a-6ad9-47e2-a600-f8c700202c34'] in dv-cinder-793885-1-iscsi is: [{'id': '5259b64a-6ad9-47e2-a600-f8c700202c34', 'name': 'tempest-TestMinimumBasicScenario-99861397-router', 'tenant_id': '43f56027f58d47f5b11d46a512f3e137', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.188'}], 'enable_snat': True}, 'gw_port_id': '2f756d86-5bac-4927-ae20-b147143147c2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:16:06Z', 'updated_at': '2021-06-01T06:16:13Z', 'revision_number': 4, 'project_id': '43f56027f58d47f5b11d46a512f3e137', 'gw_port': {'id': '2f756d86-5bac-4927-ae20-b147143147c2', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:67:ce', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5259b64a-6ad9-47e2-a600-f8c700202c34', 'device_owner': 'network:router_gateway', 'standard_attr_id': 555, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:16:08Z', 'updated_at': '2021-06-01T06:16:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '79a126cb-af44-4fd1-9f46-1de4e1ad9f55', 'name': '', 'network_id': 'a62a4246-c7f6-49f1-8116-df3533b6b298', 'tenant_id': '43f56027f58d47f5b11d46a512f3e137', 'mac_address': 'fa:16:3e:34:fe:85', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5259b64a-6ad9-47e2-a600-f8c700202c34', 'device_owner': 'network:router_interface', 'standard_attr_id': 557, 'fixed_ips': [{'subnet_id': 'c9393913-0a82-467c-b1f7-1525ee7c2eb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:16:12Z', 'updated_at': '2021-06-01T06:16:12Z', 'revision_number': 1, 'project_id': '43f56027f58d47f5b11d46a512f3e137', 'subnets': [{'id': 'c9393913-0a82-467c-b1f7-1525ee7c2eb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:16:14.812978 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ff335e30-78e2-44f9-9d7e-5c7401f9eacb admin admin] Router 5259b64a-6ad9-47e2-a600-f8c700202c34 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92230) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:16:14.898642 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-06435190-05a1-4acc-b8c5-ad9735d0177a service neutron] 10.222.0.48 "GET /v2.0/networks/0890ab9c-2266-4ef4-af73-d3ff421b9bd7?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1658244
Jun 01 06:16:14.960388 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-805f9e6d-ef69-4dc1-99d0-4b960db96d41 None None] Provisioning complete for port 79a126cb-af44-4fd1-9f46-1de4e1ad9f55 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:16:14.961118 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-805f9e6d-ef69-4dc1-99d0-4b960db96d41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:15.066281 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-805f9e6d-ef69-4dc1-99d0-4b960db96d41 None None] Port 79a126cb-af44-4fd1-9f46-1de4e1ad9f55 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:16:15.110389 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ff335e30-78e2-44f9-9d7e-5c7401f9eacb admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:16:15.121603 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-ff335e30-78e2-44f9-9d7e-5c7401f9eacb admin admin] 10.222.0.25 "PUT /v2.0/routers/5259b64a-6ad9-47e2-a600-f8c700202c34/add_router_interface HTTP/1.1" status: 200  len: 503 time: 3.4986494
Jun 01 06:16:15.216682 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1481f1b9-d4e9-454b-bd0b-51dd26c5978e req-8f242866-d828-4c5d-8cb7-e9bf9aa5de66 service neutron] 10.222.0.48 "GET /v2.0/networks/0890ab9c-2266-4ef4-af73-d3ff421b9bd7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3043382
Jun 01 06:16:15.246609 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b23925b-3b27-4e9f-ba1c-16bf63c57633 req-7b4479b5-edff-4279-ba1e-7e6d165f8cc9 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:15.249038 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0b23925b-3b27-4e9f-ba1c-16bf63c57633 req-7b4479b5-edff-4279-ba1e-7e6d165f8cc9 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 945 time: 0.2287548
Jun 01 06:16:15.388819 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:15.393166 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0b23925b-3b27-4e9f-ba1c-16bf63c57633 req-d322b692-51c0-4e4d-9478-ca0f3b8f4632 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1364553
Jun 01 06:16:15.446921 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c107d915-b68f-4d6d-a7bf-ae5ce93ff5e5 req-916067d9-2d7f-45b2-b5c2-d892c8ff4cb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:15.448486 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c107d915-b68f-4d6d-a7bf-ae5ce93ff5e5 req-916067d9-2d7f-45b2-b5c2-d892c8ff4cb4 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=ac4006667c3442a3910d548e9e9d22c0&device_id=99254438-3376-4397-ae41-1667e451ba6e HTTP/1.1" status: 200  len: 1096 time: 0.1036706
Jun 01 06:16:15.663541 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c107d915-b68f-4d6d-a7bf-ae5ce93ff5e5 req-a7275889-75f5-4bb8-a244-4504f48fbe85 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:15.667364 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c107d915-b68f-4d6d-a7bf-ae5ce93ff5e5 req-a7275889-75f5-4bb8-a244-4504f48fbe85 service neutron] 10.222.0.48 "GET /v2.0/networks?id=0890ab9c-2266-4ef4-af73-d3ff421b9bd7 HTTP/1.1" status: 200  len: 912 time: 0.2116549
Jun 01 06:16:15.843580 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c107d915-b68f-4d6d-a7bf-ae5ce93ff5e5 req-2d67349f-b54e-494f-af50-dc7af59a4af0 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 HTTP/1.1" status: 200  len: 217 time: 0.1558392
Jun 01 06:16:15.936135 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c107d915-b68f-4d6d-a7bf-ae5ce93ff5e5 req-3a78ecd4-3fd5-44f5-b09c-b8347581050f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:15.937927 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c107d915-b68f-4d6d-a7bf-ae5ce93ff5e5 req-3a78ecd4-3fd5-44f5-b09c-b8347581050f service neutron] 10.222.0.48 "GET /v2.0/subnets?id=3e980239-de35-45a0-8039-8395b5408617 HTTP/1.1" status: 200  len: 850 time: 0.0802758
Jun 01 06:16:15.964951 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:15.998196 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73cd5cf1-f8f8-43e7-b3d7-a6fd08e1405e req-109d5b3e-9429-42cf-8fce-5c87faad0999 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:15.999888 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-73cd5cf1-f8f8-43e7-b3d7-a6fd08e1405e req-109d5b3e-9429-42cf-8fce-5c87faad0999 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=99254438-3376-4397-ae41-1667e451ba6e HTTP/1.1" status: 200  len: 943 time: 0.2200837
Jun 01 06:16:16.077218 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-73cd5cf1-f8f8-43e7-b3d7-a6fd08e1405e req-e0195959-e482-4f47-9849-815635899972 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=7b7f5fd5-de63-4478-8c7a-1d742b2fa2da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0688949
Jun 01 06:16:16.097076 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c107d915-b68f-4d6d-a7bf-ae5ce93ff5e5 req-b1e455b7-abf6-45a1-a959-df676d88bb5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:16.098612 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c107d915-b68f-4d6d-a7bf-ae5ce93ff5e5 req-b1e455b7-abf6-45a1-a959-df676d88bb5a service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=0890ab9c-2266-4ef4-af73-d3ff421b9bd7&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1534715
Jun 01 06:16:16.241839 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 2f756d86-5bac-4927-ae20-b147143147c2 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:16:16.303855 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c107d915-b68f-4d6d-a7bf-ae5ce93ff5e5 req-72aeecf0-3d35-441a-b2b5-b4440bfac5a3 service neutron] 10.222.0.48 "GET /v2.0/networks/0890ab9c-2266-4ef4-af73-d3ff421b9bd7?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1957591
Jun 01 06:16:16.373894 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port 2f756d86-5bac-4927-ae20-b147143147c2 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:16:16.385092 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 2f756d86-5bac-4927-ae20-b147143147c2 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:16:16.385682 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:16.638201 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:16.673102 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port 2f756d86-5bac-4927-ae20-b147143147c2, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=2f756d86-5bac-4927-ae20-b147143147c2,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:16:16.682693 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:16.688310 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-f318493e-63e3-496e-b4a7-301e734e8e3f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:16.789736 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c107d915-b68f-4d6d-a7bf-ae5ce93ff5e5 req-29b24c87-ed47-4192-b0a5-5246bad71f69 service neutron] 10.222.0.48 "GET /v2.0/networks/0890ab9c-2266-4ef4-af73-d3ff421b9bd7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4768367
Jun 01 06:16:16.823816 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=2f756d86-5bac-4927-ae20-b147143147c2,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:16.830583 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:16.866524 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d0e5a72-b304-478d-a6bd-00b56f0c1da1 req-f8066f70-19de-4c7b-a1ec-7f266c2cc479 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:16.869340 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0d0e5a72-b304-478d-a6bd-00b56f0c1da1 req-f8066f70-19de-4c7b-a1ec-7f266c2cc479 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 945 time: 0.1141419
Jun 01 06:16:16.939253 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0d0e5a72-b304-478d-a6bd-00b56f0c1da1 req-1d2ad7fb-868a-4ecb-b0fb-f6153f766073 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0579822
Jun 01 06:16:17.354090 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78aac0a6-f4a5-448d-9f48-24758902e3cd req-249d12cf-051a-46a7-bb6c-17ea6c2b6eaf tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:17.356456 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-78aac0a6-f4a5-448d-9f48-24758902e3cd req-249d12cf-051a-46a7-bb6c-17ea6c2b6eaf tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 945 time: 0.1878526
Jun 01 06:16:17.367541 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 38152) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:16:17.374823 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-f8373692-941a-4a73-9f98-a29e36044f21 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Request body: {'floatingip': {'port_id': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:16:17.474076 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-f8373692-941a-4a73-9f98-a29e36044f21 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for floatingip, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:17.691222 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-759e3c9f-83e9-4634-a636-ee047f8e7fe0 req-f55b1b60-fc09-43be-a42e-bb4e8de6f739 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:17.694065 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-759e3c9f-83e9-4634-a636-ee047f8e7fe0 req-f55b1b60-fc09-43be-a42e-bb4e8de6f739 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=99254438-3376-4397-ae41-1667e451ba6e HTTP/1.1" status: 200  len: 943 time: 0.4310403
Jun 01 06:16:17.842529 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-759e3c9f-83e9-4634-a636-ee047f8e7fe0 req-9685c7c8-8370-4489-83f5-fdf6ceb1139c tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=7b7f5fd5-de63-4478-8c7a-1d742b2fa2da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1335280
Jun 01 06:16:18.192364 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 2f756d86-5bac-4927-ae20-b147143147c2 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:16:18.344312 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:16:18.403717 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 2f756d86-5bac-4927-ae20-b147143147c2 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:16:18.405213 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:18.410960 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] Sync routers for ids ['5259b64a-6ad9-47e2-a600-f8c700202c34'] in dv-cinder-793885-1-iscsi {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:16:18.473267 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] Routers {'5259b64a-6ad9-47e2-a600-f8c700202c34'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:16:18.481665 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b28cf190>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:16:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['5259b64a-6ad9-47e2-a600-f8c700202c34'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:18.549066 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-f8373692-941a-4a73-9f98-a29e36044f21 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:18.558107 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-f8373692-941a-4a73-9f98-a29e36044f21 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-745720'] for floatingip, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:18.657499 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=71f9d0f0-891d-4ab3-93a2-6ace16cac0a9,segment=NetworkSegment(5dda6d07-db2a-40a3-815e-42df1528c630),segment_id=5dda6d07-db2a-40a3-815e-42df1528c630)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:16:18.678805 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': '71f9d0f0-891d-4ab3-93a2-6ace16cac0a9', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'port_id': '71f9d0f0-891d-4ab3-93a2-6ace16cac0a9', 'mac_address': 'fa:16:3e:bb:1c:7b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 224, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3e980239-de35-45a0-8039-8395b5408617', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:16:18.754278 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] Set router 5259b64a-6ad9-47e2-a600-f8c700202c34 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:16:18.782714 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:18.818524 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:16:18.836731 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=71f9d0f0-891d-4ab3-93a2-6ace16cac0a9,segment=NetworkSegment(5dda6d07-db2a-40a3-815e-42df1528c630),segment_id=5dda6d07-db2a-40a3-815e-42df1528c630)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:16:18.844907 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:18.847337 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:18.855836 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.db.l3_db [None req-f8373692-941a-4a73-9f98-a29e36044f21 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Floating IP 1295facd-b7bb-4e57-99f6-ffed145c70db associated. External IP: 172.27.2.3, port: 3a7e88d5-0834-4e15-acbc-90cd1b9bca61.
Jun 01 06:16:18.977615 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=71f9d0f0-891d-4ab3-93a2-6ace16cac0a9,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:18.990464 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:19.105927 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['71f9d0f0-891d-4ab3-93a2-6ace16cac0a9'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:16:19.249495 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b28cf190>, [{'id': '5259b64a-6ad9-47e2-a600-f8c700202c34', 'name': 'tempest-TestMinimumBasicScenario-99861397-router', 'tenant_id': '43f56027f58d47f5b11d46a512f3e137', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.188'}], 'enable_snat': True}, 'gw_port_id': '2f756d86-5bac-4927-ae20-b147143147c2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:16:06Z', 'updated_at': '2021-06-01T06:16:13Z', 'revision_number': 4, 'project_id': '43f56027f58d47f5b11d46a512f3e137', 'gw_port': {'id': '2f756d86-5bac-4927-ae20-b147143147c2', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:67:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5259b64a-6ad9-47e2-a600-f8c700202c34', 'device_owner': 'network:router_gateway', 'standard_attr_id': 555, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:16:08Z', 'updated_at': '2021-06-01T06:16:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '79a126cb-af44-4fd1-9f46-1de4e1ad9f55', 'name': '', 'network_id': 'a62a4246-c7f6-49f1-8116-df3533b6b298', 'tenant_id': '43f56027f58d47f5b11d46a512f3e137', 'mac_address': 'fa:16:3e:34:fe:85', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5259b64a-6ad9-47e2-a600-f8c700202c34', 'device_owner': 'network:router_interface', 'standard_attr_id': 557, 'fixed_ips': [{'subnet_id': 'c9393913-0a82-467c-b1f7-1525ee7c2eb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:16:12Z', 'updated_at': '2021-06-01T06:16:13Z', 'revision_number': 2, 'project_id': '43f56027f58d47f5b11d46a512f3e137', 'subnets': [{'id': 'c9393913-0a82-467c-b1f7-1525ee7c2eb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:19.259165 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] Checking router: 5259b64a-6ad9-47e2-a600-f8c700202c34 for host: dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:16:19.259583 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] Updating router 5259b64a-6ad9-47e2-a600-f8c700202c34 port 79a126cb-af44-4fd1-9f46-1de4e1ad9f55 binding host dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 06:16:19.344275 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:19.451928 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddb59241-5e43-4b39-90db-56d8dce607d0 req-7014e48f-989a-4a45-ae96-68bd273b8c3f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:19.453535 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ddb59241-5e43-4b39-90db-56d8dce607d0 req-7014e48f-989a-4a45-ae96-68bd273b8c3f tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=99254438-3376-4397-ae41-1667e451ba6e HTTP/1.1" status: 200  len: 944 time: 0.4189298
Jun 01 06:16:19.588591 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ddb59241-5e43-4b39-90db-56d8dce607d0 req-2e5891bb-a5cc-45fd-afb9-a2e017af2e0e tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=7b7f5fd5-de63-4478-8c7a-1d742b2fa2da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1290667
Jun 01 06:16:19.624422 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f8373692-941a-4a73-9f98-a29e36044f21 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Router b7bdc21e-592c-4bbf-87c9-5eba5676579e has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92229) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:16:19.863826 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f8373692-941a-4a73-9f98-a29e36044f21 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92229) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:16:19.869741 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-f8373692-941a-4a73-9f98-a29e36044f21 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for floatingip, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:19.878048 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2323327e-743d-4328-8573-5b75bad008e7 None None] Sync routers for ids ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:16:19.882550 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] Notify callbacks [] for port, precommit_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:19.894348 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2323327e-743d-4328-8573-5b75bad008e7 None None] Routers {'b7bdc21e-592c-4bbf-87c9-5eba5676579e'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:16:19.896724 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-2323327e-743d-4328-8573-5b75bad008e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b226e4f0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:16:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:19.920986 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.provisioning_blocks [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] Transition to ACTIVE for port object 79a126cb-af44-4fd1-9f46-1de4e1ad9f55 will not be triggered until provisioned by entity L2. {{(pid=92232) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:16:19.935262 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:19.941419 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-4c610282-74d9-4827-a3ae-0c88aafbbcae None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:19.972504 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-f8373692-941a-4a73-9f98-a29e36044f21 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "PUT /v2.0/floatingips/1295facd-b7bb-4e57-99f6-ffed145c70db HTTP/1.1" status: 200  len: 989 time: 2.6047661
Jun 01 06:16:19.976230 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0504a6b7-2f41-4914-a3bb-2f908556d658', 'tag': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:16:19.978868 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f38319fc-d815-451f-8238-53c134760e08" -d '{"events": [{"name": "network-changed", "server_uuid": "0504a6b7-2f41-4914-a3bb-2f908556d658", "tag": "3a7e88d5-0834-4e15-acbc-90cd1b9bca61"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:16:20.097178 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:16:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0234320d-6209-4e81-9226-dd0cc42a5518 x-openstack-request-id: req-0234320d-6209-4e81-9226-dd0cc42a5518 {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:16:20.097501 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0504a6b7-2f41-4914-a3bb-2f908556d658", "tag": "3a7e88d5-0834-4e15-acbc-90cd1b9bca61", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:16:20.097796 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-0234320d-6209-4e81-9226-dd0cc42a5518 {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:16:20.098299 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0504a6b7-2f41-4914-a3bb-2f908556d658', 'tag': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61', 'status': 'completed', 'code': 200}
Jun 01 06:16:20.322505 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f38319fc-d815-451f-8238-53c134760e08 req-2ad9a4ba-f542-456e-b6a9-2bea100c1f5d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:20.347769 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f38319fc-d815-451f-8238-53c134760e08 req-2ad9a4ba-f542-456e-b6a9-2bea100c1f5d service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=0f63ca6fed3e47a6a676979240aef5c0&device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 1098 time: 0.1995616
Jun 01 06:16:20.378937 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c629f4d2-445c-4a76-b6e3-4243e11c05aa None None] Pushing event updated for resources: {'Port': ['ID=79a126cb-af44-4fd1-9f46-1de4e1ad9f55,revision_number=3']} {{(pid=92232) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:20.391163 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-c629f4d2-445c-4a76-b6e3-4243e11c05aa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.450s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:20.408690 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:16:20.457201 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-2323327e-743d-4328-8573-5b75bad008e7 None None] Set router b7bdc21e-592c-4bbf-87c9-5eba5676579e gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:16:20.512366 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] Attempting to bind port 79a126cb-af44-4fd1-9f46-1de4e1ad9f55 on host dv-cinder-793885-1-iscsi for vnic_type normal with profile  {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:16:20.513082 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] Attempting to bind port 79a126cb-af44-4fd1-9f46-1de4e1ad9f55 by drivers openvswitch,hyperv on host dv-cinder-793885-1-iscsi at level 0 using segments [{'id': '7f505287-cd09-4e79-b15f-b1cfa1fb5101', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 205, 'network_id': 'a62a4246-c7f6-49f1-8116-df3533b6b298'}] {{(pid=92232) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:16:20.514018 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] Attempting to bind port 79a126cb-af44-4fd1-9f46-1de4e1ad9f55 on network a62a4246-c7f6-49f1-8116-df3533b6b298 {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:16:20.520349 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] Checking agent: {'id': 'a41e885a-0a2b-4a22-b0dd-64799443af2f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793885-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 3, 11), 'started_at': datetime.datetime(2021, 6, 1, 6, 3, 41), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 16, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793885-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:16:20.521077 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] Checking segment: {'id': '7f505287-cd09-4e79-b15f-b1cfa1fb5101', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 205, 'network_id': 'a62a4246-c7f6-49f1-8116-df3533b6b298'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92232) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:16:20.521678 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:20.522285 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] Bound using segment: {'id': '7f505287-cd09-4e79-b15f-b1cfa1fb5101', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 205, 'network_id': 'a62a4246-c7f6-49f1-8116-df3533b6b298'} {{(pid=92232) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:16:20.522965 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.managers [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] Bound port: 79a126cb-af44-4fd1-9f46-1de4e1ad9f55, host: dv-cinder-793885-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7f505287-cd09-4e79-b15f-b1cfa1fb5101', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 205, 'network_id': 'a62a4246-c7f6-49f1-8116-df3533b6b298'}}] {{(pid=92232) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:16:20.523549 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:20.545442 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f38319fc-d815-451f-8238-53c134760e08 req-97c1cce4-9be0-452e-b729-f657b3986405 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:20.546939 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f38319fc-d815-451f-8238-53c134760e08 req-97c1cce4-9be0-452e-b729-f657b3986405 service neutron] 10.222.0.48 "GET /v2.0/networks?id=5f973ed4-521b-4b78-9a54-1336b1302fa2 HTTP/1.1" status: 200  len: 917 time: 0.2066863
Jun 01 06:16:20.731035 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.db [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] For port 79a126cb-af44-4fd1-9f46-1de4e1ad9f55, host dv-cinder-793885-1-iscsi, cleared binding levels {{(pid=92232) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:16:20.739199 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f38319fc-d815-451f-8238-53c134760e08 req-c092d9aa-6856-47cb-89a1-0a4af22db341 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=3a7e88d5-0834-4e15-acbc-90cd1b9bca61 HTTP/1.1" status: 200  len: 997 time: 0.1809573
Jun 01 06:16:20.740176 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.plugins.ml2.db [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] For port 79a126cb-af44-4fd1-9f46-1de4e1ad9f55, host dv-cinder-793885-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=79a126cb-af44-4fd1-9f46-1de4e1ad9f55,segment=NetworkSegment(7f505287-cd09-4e79-b15f-b1cfa1fb5101),segment_id=7f505287-cd09-4e79-b15f-b1cfa1fb5101)] {{(pid=92232) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:16:20.754438 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron_lib.callbacks.manager [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92232) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:20.759994 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-c639d7f2-7c5d-4fdf-a4c2-6c38a595b20d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:20.857127 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning for port 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:16:20.892151 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:16:20.893287 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:20.895350 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f38319fc-d815-451f-8238-53c134760e08 req-4af9c5e7-8df1-4e43-a5de-a68cacdcf68e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:20.897682 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f38319fc-d815-451f-8238-53c134760e08 req-4af9c5e7-8df1-4e43-a5de-a68cacdcf68e service neutron] 10.222.0.48 "GET /v2.0/subnets?id=6137ee10-ce13-45c9-8edb-31811502bfd7 HTTP/1.1" status: 200  len: 855 time: 0.1516881
Jun 01 06:16:21.025439 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c629f4d2-445c-4a76-b6e3-4243e11c05aa None None] Pushing event updated for resources: {'Port': ['ID=79a126cb-af44-4fd1-9f46-1de4e1ad9f55,revision_number=4']} {{(pid=92232) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:21.041489 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f38319fc-d815-451f-8238-53c134760e08 req-1d8370e1-a2ac-416a-bf42-1eeb21e628b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:21.041917 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG oslo_concurrency.lockutils [None req-c629f4d2-445c-4a76-b6e3-4243e11c05aa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.282s {{(pid=92232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:21.044364 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] Routers {'5259b64a-6ad9-47e2-a600-f8c700202c34'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:16:21.047416 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f38319fc-d815-451f-8238-53c134760e08 req-1d8370e1-a2ac-416a-bf42-1eeb21e628b6 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=5f973ed4-521b-4b78-9a54-1336b1302fa2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1436779
Jun 01 06:16:21.048024 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b28cf190>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:16:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['5259b64a-6ad9-47e2-a600-f8c700202c34'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:21.220815 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:21.303713 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] Set router 5259b64a-6ad9-47e2-a600-f8c700202c34 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:16:21.337847 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f38319fc-d815-451f-8238-53c134760e08 req-0c16b884-8771-4ccd-a14f-c7d8d177c081 service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2811217
Jun 01 06:16:21.362378 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '99254438-3376-4397-ae41-1667e451ba6e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '71f9d0f0-891d-4ab3-93a2-6ace16cac0a9'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:16:21.367397 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-027ad9cc-f61e-4a5b-9f76-327945382fba" -d '{"events": [{"server_uuid": "99254438-3376-4397-ae41-1667e451ba6e", "name": "network-vif-plugged", "status": "completed", "tag": "71f9d0f0-891d-4ab3-93a2-6ace16cac0a9"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:16:21.402690 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=71f9d0f0-891d-4ab3-93a2-6ace16cac0a9,segment=NetworkSegment(5dda6d07-db2a-40a3-815e-42df1528c630),segment_id=5dda6d07-db2a-40a3-815e-42df1528c630)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:16:21.426208 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-2323327e-743d-4328-8573-5b75bad008e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b226e4f0>, [{'id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'name': 'tempest-AttachVolumeShelveTestJSON-921884409-router', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20'}], 'enable_snat': True}, 'gw_port_id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:24Z', 'updated_at': '2021-06-01T06:11:44Z', 'revision_number': 4, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'gw_port': {'id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:b4:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:27Z', 'updated_at': '2021-06-01T06:11:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '1295facd-b7bb-4e57-99f6-ffed145c70db', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'floating_ip_address': '172.27.2.3', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'port_id': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 524, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'mac_address': 'fa:16:3e:84:9b:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0504a6b7-2f41-4914-a3bb-2f908556d658', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:15:54Z', 'updated_at': '2021-06-01T06:16:18Z', 'revision_number': 1, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '47f62b29-867e-4af1-9330-02c97cb95473', 'name': '', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'mac_address': 'fa:16:3e:8c:f8:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:39Z', 'updated_at': '2021-06-01T06:11:57Z', 'revision_number': 5, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'subnets': [{'id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:21.441893 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:21.450547 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-33add7c0-ed77-48da-b263-183d7437f1c2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:21.527330 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:16:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f923c1f4-1a36-4421-8e55-23c897729b86 x-openstack-request-id: req-f923c1f4-1a36-4421-8e55-23c897729b86 {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:16:21.527639 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "99254438-3376-4397-ae41-1667e451ba6e", "name": "network-vif-plugged", "status": "completed", "tag": "71f9d0f0-891d-4ab3-93a2-6ace16cac0a9", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:16:21.527978 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-f923c1f4-1a36-4421-8e55-23c897729b86 {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:16:21.528285 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '99254438-3376-4397-ae41-1667e451ba6e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '71f9d0f0-891d-4ab3-93a2-6ace16cac0a9', 'code': 200}
Jun 01 06:16:21.534524 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2323327e-743d-4328-8573-5b75bad008e7 None None] Checking router: b7bdc21e-592c-4bbf-87c9-5eba5676579e for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:16:21.580573 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2323327e-743d-4328-8573-5b75bad008e7 None None] Routers {'b7bdc21e-592c-4bbf-87c9-5eba5676579e'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:16:21.581182 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-2323327e-743d-4328-8573-5b75bad008e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b226e4f0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:16:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:21.590753 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f38319fc-d815-451f-8238-53c134760e08 req-ffa3d3d8-bbb8-46e1-bb99-f613b35e4df3 service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2461126
Jun 01 06:16:21.888595 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=71f9d0f0-891d-4ab3-93a2-6ace16cac0a9,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:21.895613 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.445s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:21.916495 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-2323327e-743d-4328-8573-5b75bad008e7 None None] Set router b7bdc21e-592c-4bbf-87c9-5eba5676579e gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:16:21.928750 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd443ddf-6e28-49d3-ac91-f1784c2c6682 req-8c056b02-328b-4387-b4db-a4bce2bf14fd tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:21.930499 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cd443ddf-6e28-49d3-ac91-f1784c2c6682 req-8c056b02-328b-4387-b4db-a4bce2bf14fd tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=99254438-3376-4397-ae41-1667e451ba6e HTTP/1.1" status: 200  len: 945 time: 0.8442810
Jun 01 06:16:21.940363 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cb74d90-6ccd-4504-9a9f-16b7659f0b9a req-1f6a663b-e83a-43b2-bbdb-38d91e73833e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:21.941968 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8cb74d90-6ccd-4504-9a9f-16b7659f0b9a req-1f6a663b-e83a-43b2-bbdb-38d91e73833e service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=99254438-3376-4397-ae41-1667e451ba6e HTTP/1.1" status: 200  len: 1098 time: 0.1616170
Jun 01 06:16:21.958250 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b28cf190>, [{'id': '5259b64a-6ad9-47e2-a600-f8c700202c34', 'name': 'tempest-TestMinimumBasicScenario-99861397-router', 'tenant_id': '43f56027f58d47f5b11d46a512f3e137', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.188'}], 'enable_snat': True}, 'gw_port_id': '2f756d86-5bac-4927-ae20-b147143147c2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:16:06Z', 'updated_at': '2021-06-01T06:16:13Z', 'revision_number': 4, 'project_id': '43f56027f58d47f5b11d46a512f3e137', 'gw_port': {'id': '2f756d86-5bac-4927-ae20-b147143147c2', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:67:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5259b64a-6ad9-47e2-a600-f8c700202c34', 'device_owner': 'network:router_gateway', 'standard_attr_id': 555, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:16:08Z', 'updated_at': '2021-06-01T06:16:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '79a126cb-af44-4fd1-9f46-1de4e1ad9f55', 'name': '', 'network_id': 'a62a4246-c7f6-49f1-8116-df3533b6b298', 'tenant_id': '43f56027f58d47f5b11d46a512f3e137', 'mac_address': 'fa:16:3e:34:fe:85', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5259b64a-6ad9-47e2-a600-f8c700202c34', 'device_owner': 'network:router_interface', 'standard_attr_id': 557, 'fixed_ips': [{'subnet_id': 'c9393913-0a82-467c-b1f7-1525ee7c2eb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:16:12Z', 'updated_at': '2021-06-01T06:16:20Z', 'revision_number': 4, 'project_id': '43f56027f58d47f5b11d46a512f3e137', 'subnets': [{'id': 'c9393913-0a82-467c-b1f7-1525ee7c2eb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:21.964325 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-415654ca-39bb-4789-a7ea-bbccd55273d9 None None] The sync data for ids ['5259b64a-6ad9-47e2-a600-f8c700202c34'] in dv-cinder-793885-1-iscsi is: [{'id': '5259b64a-6ad9-47e2-a600-f8c700202c34', 'name': 'tempest-TestMinimumBasicScenario-99861397-router', 'tenant_id': '43f56027f58d47f5b11d46a512f3e137', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.188'}], 'enable_snat': True}, 'gw_port_id': '2f756d86-5bac-4927-ae20-b147143147c2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:16:06Z', 'updated_at': '2021-06-01T06:16:13Z', 'revision_number': 4, 'project_id': '43f56027f58d47f5b11d46a512f3e137', 'gw_port': {'id': '2f756d86-5bac-4927-ae20-b147143147c2', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:67:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5259b64a-6ad9-47e2-a600-f8c700202c34', 'device_owner': 'network:router_gateway', 'standard_attr_id': 555, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:16:08Z', 'updated_at': '2021-06-01T06:16:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '79a126cb-af44-4fd1-9f46-1de4e1ad9f55', 'name': '', 'network_id': 'a62a4246-c7f6-49f1-8116-df3533b6b298', 'tenant_id': '43f56027f58d47f5b11d46a512f3e137', 'mac_address': 'fa:16:3e:34:fe:85', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5259b64a-6ad9-47e2-a600-f8c700202c34', 'device_owner': 'network:router_interface', 'standard_attr_id': 557, 'fixed_ips': [{'subnet_id': 'c9393913-0a82-467c-b1f7-1525ee7c2eb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:16:12Z', 'updated_at': '2021-06-01T06:16:20Z', 'revision_number': 4, 'project_id': '43f56027f58d47f5b11d46a512f3e137', 'subnets': [{'id': 'c9393913-0a82-467c-b1f7-1525ee7c2eb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:16:22.016641 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cd443ddf-6e28-49d3-ac91-f1784c2c6682 req-15306f4b-93c3-4a44-beb4-a8d82c3daac4 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=7b7f5fd5-de63-4478-8c7a-1d742b2fa2da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0786085
Jun 01 06:16:22.070035 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8cb74d90-6ccd-4504-9a9f-16b7659f0b9a req-da5f9c58-653b-4289-b9b5-1032894049db service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=7b7f5fd5-de63-4478-8c7a-1d742b2fa2da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1119208
Jun 01 06:16:22.318346 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 79a126cb-af44-4fd1-9f46-1de4e1ad9f55 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:16:22.591128 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning for port 79a126cb-af44-4fd1-9f46-1de4e1ad9f55 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:16:22.601413 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 79a126cb-af44-4fd1-9f46-1de4e1ad9f55 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:16:22.601787 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:22.694460 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-2323327e-743d-4328-8573-5b75bad008e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b226e4f0>, [{'id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'name': 'tempest-AttachVolumeShelveTestJSON-921884409-router', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20'}], 'enable_snat': True}, 'gw_port_id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:24Z', 'updated_at': '2021-06-01T06:11:44Z', 'revision_number': 4, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'gw_port': {'id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:b4:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:27Z', 'updated_at': '2021-06-01T06:11:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '1295facd-b7bb-4e57-99f6-ffed145c70db', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'floating_ip_address': '172.27.2.3', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'port_id': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 524, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'mac_address': 'fa:16:3e:84:9b:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0504a6b7-2f41-4914-a3bb-2f908556d658', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:15:54Z', 'updated_at': '2021-06-01T06:16:18Z', 'revision_number': 1, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '47f62b29-867e-4af1-9330-02c97cb95473', 'name': '', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'mac_address': 'fa:16:3e:8c:f8:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:39Z', 'updated_at': '2021-06-01T06:11:57Z', 'revision_number': 5, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'subnets': [{'id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:22.699015 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2323327e-743d-4328-8573-5b75bad008e7 None None] The sync data for ids ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'] in dv-cinder-793885-1-iscsi is: [{'id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'name': 'tempest-AttachVolumeShelveTestJSON-921884409-router', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20'}], 'enable_snat': True}, 'gw_port_id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:24Z', 'updated_at': '2021-06-01T06:11:44Z', 'revision_number': 4, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'gw_port': {'id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:b4:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:27Z', 'updated_at': '2021-06-01T06:11:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '1295facd-b7bb-4e57-99f6-ffed145c70db', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'floating_ip_address': '172.27.2.3', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'port_id': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 524, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'mac_address': 'fa:16:3e:84:9b:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0504a6b7-2f41-4914-a3bb-2f908556d658', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:15:54Z', 'updated_at': '2021-06-01T06:16:18Z', 'revision_number': 1, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '47f62b29-867e-4af1-9330-02c97cb95473', 'name': '', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'mac_address': 'fa:16:3e:8c:f8:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:39Z', 'updated_at': '2021-06-01T06:11:57Z', 'revision_number': 5, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'subnets': [{'id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:16:22.780026 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:22.891968 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] For port 79a126cb-af44-4fd1-9f46-1de4e1ad9f55, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=79a126cb-af44-4fd1-9f46-1de4e1ad9f55,segment=NetworkSegment(7f505287-cd09-4e79-b15f-b1cfa1fb5101),segment_id=7f505287-cd09-4e79-b15f-b1cfa1fb5101)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:16:22.909435 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:22.921500 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.004s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:23.136155 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Pushing event updated for resources: {'Port': ['ID=79a126cb-af44-4fd1-9f46-1de4e1ad9f55,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:23.142987 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:23.297467 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa53357e-d492-4dee-9c6a-731d678194a2 None None] New status for floating IP 1295facd-b7bb-4e57-99f6-ffed145c70db: ACTIVE {{(pid=92232) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 06:16:23.584164 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab42d44f-02f8-4e48-ba7f-52d5c2b4fa4d req-12eb91cd-c8d3-43a3-b79f-ac09467c1d45 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:23.585940 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ab42d44f-02f8-4e48-ba7f-52d5c2b4fa4d req-12eb91cd-c8d3-43a3-b79f-ac09467c1d45 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=99254438-3376-4397-ae41-1667e451ba6e HTTP/1.1" status: 200  len: 945 time: 0.3819230
Jun 01 06:16:23.653689 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ab42d44f-02f8-4e48-ba7f-52d5c2b4fa4d req-af3d8d9f-5968-4438-976d-006eed49f337 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=7b7f5fd5-de63-4478-8c7a-1d742b2fa2da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0600150
Jun 01 06:16:24.034609 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcc8dc5f-1a42-439c-8c01-b2a24b02432b req-8f0a1b1e-3fb4-4559-9a6b-fd32908d9ec7 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:24.036471 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fcc8dc5f-1a42-439c-8c01-b2a24b02432b req-8f0a1b1e-3fb4-4559-9a6b-fd32908d9ec7 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=99254438-3376-4397-ae41-1667e451ba6e HTTP/1.1" status: 200  len: 945 time: 0.2773814
Jun 01 06:16:24.046327 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 38196) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:16:24.052429 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-24c4a866-5514-47c9-a807-6ffe15072387 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Request body: {'floatingip': {'port_id': '71f9d0f0-891d-4ab3-93a2-6ace16cac0a9'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:16:24.171589 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-24c4a866-5514-47c9-a807-6ffe15072387 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for floatingip, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:24.199665 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 79a126cb-af44-4fd1-9f46-1de4e1ad9f55 up at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:16:24.375644 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Provisioning complete for port 79a126cb-af44-4fd1-9f46-1de4e1ad9f55 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:16:24.376224 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:25.233174 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-24c4a866-5514-47c9-a807-6ffe15072387 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:25.273913 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-24c4a866-5514-47c9-a807-6ffe15072387 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-745720'] for floatingip, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:25.523135 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.db.l3_db [None req-24c4a866-5514-47c9-a807-6ffe15072387 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Floating IP 0100ff6f-a2fa-45e1-8d71-0e51424da06c associated. External IP: 172.27.2.47, port: 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9.
Jun 01 06:16:25.720440 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:16:26.117517 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-24c4a866-5514-47c9-a807-6ffe15072387 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Router f8aef563-57d3-45c3-afd4-23442c8f572d has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92230) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:16:26.360489 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-24c4a866-5514-47c9-a807-6ffe15072387 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:16:26.367419 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-24c4a866-5514-47c9-a807-6ffe15072387 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for floatingip, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:26.372195 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4fbbc7f9-9dc4-4c94-98f0-d6ffbac4fd18 None None] Sync routers for ids ['f8aef563-57d3-45c3-afd4-23442c8f572d'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:16:26.387245 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4fbbc7f9-9dc4-4c94-98f0-d6ffbac4fd18 None None] Routers {'f8aef563-57d3-45c3-afd4-23442c8f572d'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:16:26.388125 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-4fbbc7f9-9dc4-4c94-98f0-d6ffbac4fd18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b290b490>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:16:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['f8aef563-57d3-45c3-afd4-23442c8f572d'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:26.467825 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-24c4a866-5514-47c9-a807-6ffe15072387 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "PUT /v2.0/floatingips/0100ff6f-a2fa-45e1-8d71-0e51424da06c HTTP/1.1" status: 200  len: 990 time: 2.4183612
Jun 01 06:16:26.467825 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '99254438-3376-4397-ae41-1667e451ba6e', 'tag': '71f9d0f0-891d-4ab3-93a2-6ace16cac0a9'}] {{(pid=92230) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:16:26.469314 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a8971187fdc179bafebfda031591b22633150c3ea1d9449252a7819502f19756" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ad323be8-3d39-4b30-8da3-e53e6d55738c" -d '{"events": [{"name": "network-changed", "server_uuid": "99254438-3376-4397-ae41-1667e451ba6e", "tag": "71f9d0f0-891d-4ab3-93a2-6ace16cac0a9"}]}' {{(pid=92230) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:16:26.525566 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:16:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d662d4f1-f3fc-449a-891a-e57d23cd1cae x-openstack-request-id: req-d662d4f1-f3fc-449a-891a-e57d23cd1cae {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:16:26.525894 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "99254438-3376-4397-ae41-1667e451ba6e", "tag": "71f9d0f0-891d-4ab3-93a2-6ace16cac0a9", "status": "completed", "code": 200}]} {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:16:26.526179 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-d662d4f1-f3fc-449a-891a-e57d23cd1cae {{(pid=92230) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:16:26.526608 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '99254438-3376-4397-ae41-1667e451ba6e', 'tag': '71f9d0f0-891d-4ab3-93a2-6ace16cac0a9', 'status': 'completed', 'code': 200}
Jun 01 06:16:26.679480 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad323be8-3d39-4b30-8da3-e53e6d55738c req-b9239eac-6923-4942-af07-9e88466d10ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:26.683039 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ad323be8-3d39-4b30-8da3-e53e6d55738c req-b9239eac-6923-4942-af07-9e88466d10ad service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=ac4006667c3442a3910d548e9e9d22c0&device_id=99254438-3376-4397-ae41-1667e451ba6e HTTP/1.1" status: 200  len: 1098 time: 0.1289337
Jun 01 06:16:26.692678 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-4fbbc7f9-9dc4-4c94-98f0-d6ffbac4fd18 None None] Set router f8aef563-57d3-45c3-afd4-23442c8f572d gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:16:26.853995 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad323be8-3d39-4b30-8da3-e53e6d55738c req-7356da81-4898-4fd7-b17a-ade0865f43c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:26.857888 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ad323be8-3d39-4b30-8da3-e53e6d55738c req-7356da81-4898-4fd7-b17a-ade0865f43c8 service neutron] 10.222.0.48 "GET /v2.0/networks?id=0890ab9c-2266-4ef4-af73-d3ff421b9bd7 HTTP/1.1" status: 200  len: 912 time: 0.1624811
Jun 01 06:16:27.031588 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ad323be8-3d39-4b30-8da3-e53e6d55738c req-22ccfaa5-0217-4c92-9322-3c4cd2b694ac service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 HTTP/1.1" status: 200  len: 998 time: 0.1610610
Jun 01 06:16:27.112428 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad323be8-3d39-4b30-8da3-e53e6d55738c req-a243246c-5216-4189-ba02-f2213dd75c53 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:27.114418 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ad323be8-3d39-4b30-8da3-e53e6d55738c req-a243246c-5216-4189-ba02-f2213dd75c53 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=3e980239-de35-45a0-8039-8395b5408617 HTTP/1.1" status: 200  len: 850 time: 0.0696125
Jun 01 06:16:27.194677 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-4fbbc7f9-9dc4-4c94-98f0-d6ffbac4fd18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b290b490>, [{'id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'name': 'tempest-AttachVolumeTestJSON-1575365070-router', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214'}], 'enable_snat': True}, 'gw_port_id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:23Z', 'updated_at': '2021-06-01T06:11:31Z', 'revision_number': 4, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'gw_port': {'id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:02:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '0100ff6f-a2fa-45e1-8d71-0e51424da06c', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'floating_ip_address': '172.27.2.47', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'port_id': '71f9d0f0-891d-4ab3-93a2-6ace16cac0a9', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 551, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'mac_address': 'fa:16:3e:bb:1c:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99254438-3376-4397-ae41-1667e451ba6e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:16:05Z', 'updated_at': '2021-06-01T06:16:25Z', 'revision_number': 1, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8e48657d-a82c-420f-8462-d947f458adb4', 'name': '', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'mac_address': 'fa:16:3e:9f:72:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '3e980239-de35-45a0-8039-8395b5408617', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:30Z', 'updated_at': '2021-06-01T06:11:46Z', 'revision_number': 5, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'subnets': [{'id': '3e980239-de35-45a0-8039-8395b5408617', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:27.199594 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4fbbc7f9-9dc4-4c94-98f0-d6ffbac4fd18 None None] Checking router: f8aef563-57d3-45c3-afd4-23442c8f572d for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:16:27.209970 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4fbbc7f9-9dc4-4c94-98f0-d6ffbac4fd18 None None] Routers {'f8aef563-57d3-45c3-afd4-23442c8f572d'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:16:27.210749 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-4fbbc7f9-9dc4-4c94-98f0-d6ffbac4fd18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b290b490>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:16:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['f8aef563-57d3-45c3-afd4-23442c8f572d'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:27.224794 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad323be8-3d39-4b30-8da3-e53e6d55738c req-b272ef44-3f40-464e-a4d1-42cc8c88183a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:27.226619 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ad323be8-3d39-4b30-8da3-e53e6d55738c req-b272ef44-3f40-464e-a4d1-42cc8c88183a service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=0890ab9c-2266-4ef4-af73-d3ff421b9bd7&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1049836
Jun 01 06:16:27.429862 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-4fbbc7f9-9dc4-4c94-98f0-d6ffbac4fd18 None None] Set router f8aef563-57d3-45c3-afd4-23442c8f572d gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:16:27.444320 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ad323be8-3d39-4b30-8da3-e53e6d55738c req-0ed3d292-0f8f-40d4-8a99-7b92b874de51 service neutron] 10.222.0.48 "GET /v2.0/networks/0890ab9c-2266-4ef4-af73-d3ff421b9bd7?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2095151
Jun 01 06:16:27.616017 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ad323be8-3d39-4b30-8da3-e53e6d55738c req-7889f824-6fd2-4cf3-a590-5eac43dd1810 service neutron] 10.222.0.48 "GET /v2.0/networks/0890ab9c-2266-4ef4-af73-d3ff421b9bd7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1645057
Jun 01 06:16:28.008960 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-4fbbc7f9-9dc4-4c94-98f0-d6ffbac4fd18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b290b490>, [{'id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'name': 'tempest-AttachVolumeTestJSON-1575365070-router', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214'}], 'enable_snat': True}, 'gw_port_id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:23Z', 'updated_at': '2021-06-01T06:11:31Z', 'revision_number': 4, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'gw_port': {'id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:02:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '0100ff6f-a2fa-45e1-8d71-0e51424da06c', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'floating_ip_address': '172.27.2.47', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'port_id': '71f9d0f0-891d-4ab3-93a2-6ace16cac0a9', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 551, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'mac_address': 'fa:16:3e:bb:1c:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99254438-3376-4397-ae41-1667e451ba6e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:16:05Z', 'updated_at': '2021-06-01T06:16:25Z', 'revision_number': 1, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8e48657d-a82c-420f-8462-d947f458adb4', 'name': '', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'mac_address': 'fa:16:3e:9f:72:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '3e980239-de35-45a0-8039-8395b5408617', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:30Z', 'updated_at': '2021-06-01T06:11:46Z', 'revision_number': 5, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'subnets': [{'id': '3e980239-de35-45a0-8039-8395b5408617', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:16:28.014944 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4fbbc7f9-9dc4-4c94-98f0-d6ffbac4fd18 None None] The sync data for ids ['f8aef563-57d3-45c3-afd4-23442c8f572d'] in dv-cinder-793885-1-iscsi is: [{'id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'name': 'tempest-AttachVolumeTestJSON-1575365070-router', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214'}], 'enable_snat': True}, 'gw_port_id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:23Z', 'updated_at': '2021-06-01T06:11:31Z', 'revision_number': 4, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'gw_port': {'id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:02:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '0100ff6f-a2fa-45e1-8d71-0e51424da06c', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'floating_ip_address': '172.27.2.47', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'port_id': '71f9d0f0-891d-4ab3-93a2-6ace16cac0a9', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 551, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'mac_address': 'fa:16:3e:bb:1c:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99254438-3376-4397-ae41-1667e451ba6e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:16:05Z', 'updated_at': '2021-06-01T06:16:25Z', 'revision_number': 1, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8e48657d-a82c-420f-8462-d947f458adb4', 'name': '', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'mac_address': 'fa:16:3e:9f:72:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '3e980239-de35-45a0-8039-8395b5408617', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:30Z', 'updated_at': '2021-06-01T06:11:46Z', 'revision_number': 5, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'subnets': [{'id': '3e980239-de35-45a0-8039-8395b5408617', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:16:28.294470 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-89519e38-d092-403f-ab10-336b50b8f98e None None] New status for floating IP 0100ff6f-a2fa-45e1-8d71-0e51424da06c: ACTIVE {{(pid=92232) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 06:16:29.677050 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-cda4ec4d-48d7-4d01-9096-dd3b623928e0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:29.678536 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-cda4ec4d-48d7-4d01-9096-dd3b623928e0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/networks?id=d36c4486-6b2d-4439-996b-f13c04a98cb8 HTTP/1.1" status: 200  len: 815 time: 0.1711526
Jun 01 06:16:29.694285 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-7da58db1-0c7b-42b9-9442-902fe104fa6e tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/quotas/c0ca2b878b874fe4af6e7b9fa8f6cf59 HTTP/1.1" status: 200  len: 375 time: 0.0098743
Jun 01 06:16:29.787043 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-b8813315-c420-429d-ae55-80e2bb04ab95 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=c0ca2b878b874fe4af6e7b9fa8f6cf59&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0851245
Jun 01 06:16:29.992966 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-763c23a0-7488-491a-8b74-9d598efb80d8 service neutron] 10.222.0.25 "GET /v2.0/networks/d36c4486-6b2d-4439-996b-f13c04a98cb8?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1919587
Jun 01 06:16:30.142836 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-db4db88d-854b-46aa-9651-d4579a90b58f service neutron] 10.222.0.25 "GET /v2.0/networks/d36c4486-6b2d-4439-996b-f13c04a98cb8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1440291
Jun 01 06:16:30.356723 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c26095e7-3059-4b47-af51-2c204bd4828e req-7322b775-f9fb-4162-bf0c-6c322a4e3c67 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 210 time: 0.0502970
Jun 01 06:16:31.831630 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6cba63f0-0bf5-460e-ba91-c79e8e04a882 req-a84f05d0-9c09-4011-8ef2-5d2e5f6d4988 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 210 time: 0.1989877
Jun 01 06:16:31.926301 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db45bc18-2743-4965-a4d2-44d2385d34d3 req-4ed5ed49-f907-47b6-a3d5-7a4c48ffe74a tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:31.932630 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-db45bc18-2743-4965-a4d2-44d2385d34d3 req-4ed5ed49-f907-47b6-a3d5-7a4c48ffe74a tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 946 time: 0.3934062
Jun 01 06:16:32.027297 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-db45bc18-2743-4965-a4d2-44d2385d34d3 req-e1a51ad9-85d0-42db-b637-a818918ef589 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0886302
Jun 01 06:16:32.034211 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-84c0bcdf-9625-4a45-8310-5d9c8084a3f9 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:32.035721 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-84c0bcdf-9625-4a45-8310-5d9c8084a3f9 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.48 "GET /v2.0/networks?id=d36c4486-6b2d-4439-996b-f13c04a98cb8 HTTP/1.1" status: 200  len: 815 time: 0.3510783
Jun 01 06:16:32.051581 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Request body: {'port': {'device_id': '5f919b7d-49a2-4b7d-bab0-b076bda23370', 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8', 'admin_state_up': True, 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:16:32.208724 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:16:32.213494 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Usage tracker for resource:port and tenant:c0ca2b878b874fe4af6e7b9fa8f6cf59 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:16:32.217178 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Quota usage for port was recalculated. Used quota:2. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:16:32.225530 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:16:32.238454 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Made reservation on behalf of c0ca2b878b874fe4af6e7b9fa8f6cf59 for: {'port': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:16:32.242080 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:32.471885 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Allocated IP 172.20.0.3 (d36c4486-6b2d-4439-996b-f13c04a98cb8/27e7a9e0-ab4e-478c-aff2-55a26159dc84/8a7ac687-d801-4596-95ac-7b5a0bb4a7a7) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:16:32.828834 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:32.847651 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Transition to ACTIVE for port object 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 will not be triggered until provisioned by entity DHCP. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:16:32.880254 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:32.913063 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:32.988180 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Network d36c4486-6b2d-4439-996b-f13c04a98cb8 is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:16:32.997596 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:16:33.013823 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:16:33.274992 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Pushing event updated for resources: {'Port': ['ID=8a7ac687-d801-4596-95ac-7b5a0bb4a7a7,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:33.282797 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:33.283639 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:33.302734 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:33.304563 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:33.304563 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:33.304563 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:33.304563 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:33.304563 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:33.305324 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:33.305324 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:33.305550 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:33.306254 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:33.306816 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:33.307184 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:33.334643 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.421s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:33.355231 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.3091326
Jun 01 06:16:33.389528 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33820215-ea2a-40f4-beb8-facfe23924e6 req-f9705326-20ae-4f4d-b849-156bf1953a11 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:33.391185 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-33820215-ea2a-40f4-beb8-facfe23924e6 req-f9705326-20ae-4f4d-b849-156bf1953a11 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Synchronizing usage tracker for tenant:c0ca2b878b874fe4af6e7b9fa8f6cf59 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:16:33.422100 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-33820215-ea2a-40f4-beb8-facfe23924e6 req-f9705326-20ae-4f4d-b849-156bf1953a11 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Unset dirty status for tenant:c0ca2b878b874fe4af6e7b9fa8f6cf59 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:16:33.424617 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-33820215-ea2a-40f4-beb8-facfe23924e6 req-f9705326-20ae-4f4d-b849-156bf1953a11 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 931 time: 0.3407712
Jun 01 06:16:33.478518 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-317b8c89-9152-4dcc-b46c-d0a2965ea5a4 None None] Provisioning for port 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:16:33.484954 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-317b8c89-9152-4dcc-b46c-d0a2965ea5a4 None None] Provisioning complete for port 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:16:33.485420 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-317b8c89-9152-4dcc-b46c-d0a2965ea5a4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:33.491289 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-33820215-ea2a-40f4-beb8-facfe23924e6 req-6af3fef9-3593-425b-bd9e-9e039538aa08 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0589702
Jun 01 06:16:33.554073 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-317b8c89-9152-4dcc-b46c-d0a2965ea5a4 None None] Port 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:16:37.133072 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 38376) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:16:37.266903 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e6d688ba-ebb9-413f-8b0f-52a4fd17369c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:37.281979 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-e6d688ba-ebb9-413f-8b0f-52a4fd17369c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:16:37.287449 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-e6d688ba-ebb9-413f-8b0f-52a4fd17369c admin admin] Usage tracker for resource:security_group_rule and tenant:97f0e4e9537043379f89860b8778e874 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:16:37.292752 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-e6d688ba-ebb9-413f-8b0f-52a4fd17369c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:16:37.300186 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-e6d688ba-ebb9-413f-8b0f-52a4fd17369c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:16:37.391513 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e6d688ba-ebb9-413f-8b0f-52a4fd17369c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:37.395179 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e6d688ba-ebb9-413f-8b0f-52a4fd17369c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:37.403022 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-361f48c9-ee67-4471-a45a-d0f3bbad7da4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:37.446708 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6d688ba-ebb9-413f-8b0f-52a4fd17369c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d4b54e62-b37e-4c26-8e4a-493828f0b6c7,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:37.450124 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-e6d688ba-ebb9-413f-8b0f-52a4fd17369c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:37.457756 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-e6d688ba-ebb9-413f-8b0f-52a4fd17369c admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=97f0e4e9537043379f89860b8778e874&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3194265
Jun 01 06:16:37.457756 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 38382) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:16:37.518043 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-f635f684-0256-480a-b023-83cb61e44967 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:37.544867 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-f635f684-0256-480a-b023-83cb61e44967 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:37.616919 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-f635f684-0256-480a-b023-83cb61e44967 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:37.621488 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b208b038-fa2b-4c8f-947a-6d56d59c67bc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:37.632320 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f635f684-0256-480a-b023-83cb61e44967 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d4b54e62-b37e-4c26-8e4a-493828f0b6c7,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:37.635244 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-f635f684-0256-480a-b023-83cb61e44967 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:37.641221 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-f635f684-0256-480a-b023-83cb61e44967 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:37.644599 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-f635f684-0256-480a-b023-83cb61e44967 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/d4b54e62-b37e-4c26-8e4a-493828f0b6c7 HTTP/1.1" status: 204  len: 168 time: 0.1842887
Jun 01 06:16:38.337498 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-7ac1119c-2a41-41a4-9130-edac8c088f84 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:41.218060 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:42.342579 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b19a8b7b-9501-4720-a878-5155fe9ad22f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:43.267330 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:44.821227 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Request body: {'port': {'device_id': '5f919b7d-49a2-4b7d-bab0-b076bda23370', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79388'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:16:45.111590 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:45.209689 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-044f73c2-6b9c-4f20-a84d-dc29d8b9fa51 req-ddf0aa6f-194c-48d4-8343-ad92f71e56d4 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:45.211093 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-044f73c2-6b9c-4f20-a84d-dc29d8b9fa51 req-ddf0aa6f-194c-48d4-8343-ad92f71e56d4 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 946 time: 0.3558276
Jun 01 06:16:45.213834 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d741bb40-38f7-445b-9e50-cce20041e3e0 req-27e6436e-6a45-450a-905c-ba39453524c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:45.215212 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d741bb40-38f7-445b-9e50-cce20041e3e0 req-27e6436e-6a45-450a-905c-ba39453524c2 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=60be617f683c42a081ab3f50c3bdf8f1&device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 1099 time: 0.4715238
Jun 01 06:16:45.225292 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c19ee22-3cd8-4dc9-84d0-83a7bc299410 req-57ebc8d9-ddd0-4053-9b85-abfa5e726858 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:45.226793 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7c19ee22-3cd8-4dc9-84d0-83a7bc299410 req-57ebc8d9-ddd0-4053-9b85-abfa5e726858 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 931 time: 0.3734658
Jun 01 06:16:45.372767 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:45.557434 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-044f73c2-6b9c-4f20-a84d-dc29d8b9fa51 req-4621bc75-a2f3-4b44-a085-30883f2ac83b tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.3269613
Jun 01 06:16:45.568259 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7c19ee22-3cd8-4dc9-84d0-83a7bc299410 req-01d56899-de11-421f-b983-26f5f97c351b tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3146918
Jun 01 06:16:45.688650 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d741bb40-38f7-445b-9e50-cce20041e3e0 req-fbbc6e0d-7b93-4ec2-a014-89c85bebb45a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:45.690135 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d741bb40-38f7-445b-9e50-cce20041e3e0 req-fbbc6e0d-7b93-4ec2-a014-89c85bebb45a service neutron] 10.222.0.48 "GET /v2.0/networks?id=6200246e-b324-4384-a0a9-6dc6726e2c6d HTTP/1.1" status: 200  len: 910 time: 0.4387500
Jun 01 06:16:45.832326 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d741bb40-38f7-445b-9e50-cce20041e3e0 req-93413df6-d2d5-4c2a-9885-95e76524a597 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=6c07ed73-1eed-4e63-90ca-60843e890090 HTTP/1.1" status: 200  len: 1002 time: 0.1222532
Jun 01 06:16:45.955253 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d741bb40-38f7-445b-9e50-cce20041e3e0 req-450e6ee0-0904-4acb-9321-cd604e70c8b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:45.956729 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d741bb40-38f7-445b-9e50-cce20041e3e0 req-450e6ee0-0904-4acb-9321-cd604e70c8b4 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=1fbcd64f-1378-4ec3-bd16-df65964c6028 HTTP/1.1" status: 200  len: 848 time: 0.1143959
Jun 01 06:16:45.958759 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 {{(pid=92229) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:16:45.968061 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:45.968855 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:46.029246 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Transition to ACTIVE for port object 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 will not be triggered until provisioned by entity L2. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:16:46.037734 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2077419'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:46.044069 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-5673245f-8b11-400d-ae60-6fb46eedb080 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:46.186825 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Pushing event updated for resources: {'Port': ['ID=8a7ac687-d801-4596-95ac-7b5a0bb4a7a7,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:46.190269 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:46.234920 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d741bb40-38f7-445b-9e50-cce20041e3e0 req-49181bfc-6064-4690-94c5-016a9b250e55 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:46.236360 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d741bb40-38f7-445b-9e50-cce20041e3e0 req-49181bfc-6064-4690-94c5-016a9b250e55 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=6200246e-b324-4384-a0a9-6dc6726e2c6d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2704835
Jun 01 06:16:46.410605 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Attempting to bind port 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 on host hv-cinder-79388 for vnic_type normal with profile  {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:16:46.410849 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Attempting to bind port 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 by drivers openvswitch,hyperv on host hv-cinder-79388 at level 0 using segments [{'id': 'c40d74a4-eecc-4c63-8fd5-38ee39e77ccd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 221, 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8'}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:16:46.411175 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Attempting to bind port 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 on network d36c4486-6b2d-4439-996b-f13c04a98cb8 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:16:46.428689 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Port 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 on network d36c4486-6b2d-4439-996b-f13c04a98cb8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79388 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 06:16:46.429007 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Attempting to bind port 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 on network d36c4486-6b2d-4439-996b-f13c04a98cb8 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:16:46.440490 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Checking agent: {'id': '56148394-2131-4d06-bcfa-c032301591b8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79388', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'started_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 16, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:16:46.440828 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Checking segment: {'id': 'c40d74a4-eecc-4c63-8fd5-38ee39e77ccd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 221, 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:16:46.441178 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Bound using segment: {'id': 'c40d74a4-eecc-4c63-8fd5-38ee39e77ccd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 221, 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8'} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:16:46.441626 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Bound port: 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7, host: hv-cinder-79388, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c40d74a4-eecc-4c63-8fd5-38ee39e77ccd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 221, 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8'}}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:16:46.441974 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:46.453305 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d741bb40-38f7-445b-9e50-cce20041e3e0 req-90e00f1c-047c-4349-99b5-18266cf12bb8 service neutron] 10.222.0.48 "GET /v2.0/networks/6200246e-b324-4384-a0a9-6dc6726e2c6d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1871309
Jun 01 06:16:46.658307 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] For port 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7, host hv-cinder-79388, cleared binding levels {{(pid=92229) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:16:46.672811 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d741bb40-38f7-445b-9e50-cce20041e3e0 req-dd989a33-c6ca-493b-8da4-0259b4233a25 service neutron] 10.222.0.48 "GET /v2.0/networks/6200246e-b324-4384-a0a9-6dc6726e2c6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2096539
Jun 01 06:16:46.674349 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] For port 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7, host hv-cinder-79388, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=8a7ac687-d801-4596-95ac-7b5a0bb4a7a7,segment=NetworkSegment(c40d74a4-eecc-4c63-8fd5-38ee39e77ccd),segment_id=c40d74a4-eecc-4c63-8fd5-38ee39e77ccd)] {{(pid=92229) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:16:46.679470 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2077419'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:46.684445 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-f6c5d64e-a1ae-4c10-bd84-ad0680628fcd tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:46.880700 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:46.881428 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:46.882723 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] 10.222.0.48 "PUT /v2.0/ports/8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 HTTP/1.1" status: 200  len: 1093 time: 2.2323246
Jun 01 06:16:46.885142 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5f919b7d-49a2-4b7d-bab0-b076bda23370', 'tag': '8a7ac687-d801-4596-95ac-7b5a0bb4a7a7'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:16:46.887534 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6005128a-818b-4734-bc3d-5786bc9e627f" -d '{"events": [{"name": "network-changed", "server_uuid": "5f919b7d-49a2-4b7d-bab0-b076bda23370", "tag": "8a7ac687-d801-4596-95ac-7b5a0bb4a7a7"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:16:46.929523 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Pushing event updated for resources: {'Port': ['ID=8a7ac687-d801-4596-95ac-7b5a0bb4a7a7,revision_number=3']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:46.936733 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.252s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:47.160481 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00cd9357-1db2-4937-a5e0-3d08c974d66c req-43743bf7-3d75-490b-9c5d-4be19bd1ad67 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:47.162042 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-00cd9357-1db2-4937-a5e0-3d08c974d66c req-43743bf7-3d75-490b-9c5d-4be19bd1ad67 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 946 time: 0.4382951
Jun 01 06:16:47.168717 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76f50c6a-2fe0-4d1f-8005-9e4fd5041a85 req-e7749f44-8237-4161-a4e0-8518ff19c222 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:47.170122 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-76f50c6a-2fe0-4d1f-8005-9e4fd5041a85 req-e7749f44-8237-4161-a4e0-8518ff19c222 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=60be617f683c42a081ab3f50c3bdf8f1&device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 1099 time: 0.3970532
Jun 01 06:16:47.183296 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-120560cf-9e47-47a5-9981-70cab3cb671c req-7a2f63e5-8bd1-4da6-b8af-d3f1d903c56d tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:47.183296 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-120560cf-9e47-47a5-9981-70cab3cb671c req-7a2f63e5-8bd1-4da6-b8af-d3f1d903c56d tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 943 time: 0.4605708
Jun 01 06:16:47.359035 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-00cd9357-1db2-4937-a5e0-3d08c974d66c req-5f8a4020-6924-4638-9e1c-245c68e7cf73 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1879070
Jun 01 06:16:47.361194 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-ec47c819-e44c-4117-beb1-4dd95f2d286d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:47.362827 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-ec47c819-e44c-4117-beb1-4dd95f2d286d service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=c0ca2b878b874fe4af6e7b9fa8f6cf59&device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 1096 time: 0.4229734
Jun 01 06:16:47.371985 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-120560cf-9e47-47a5-9981-70cab3cb671c req-13554985-7287-4e9e-9eaf-44bfa39d2399 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1538045
Jun 01 06:16:47.456757 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-26c92ff2-3a7c-4d1a-9290-1e96261c2181 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 HTTP/1.1" status: 200  len: 217 time: 0.0738628
Jun 01 06:16:47.473851 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:16:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-085a4eec-6a41-4903-9ef1-0c25d27c670d x-openstack-request-id: req-085a4eec-6a41-4903-9ef1-0c25d27c670d {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:16:47.474285 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5f919b7d-49a2-4b7d-bab0-b076bda23370", "tag": "8a7ac687-d801-4596-95ac-7b5a0bb4a7a7", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:16:47.474577 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-085a4eec-6a41-4903-9ef1-0c25d27c670d {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:16:47.475014 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5f919b7d-49a2-4b7d-bab0-b076bda23370', 'tag': '8a7ac687-d801-4596-95ac-7b5a0bb4a7a7', 'status': 'completed', 'code': 200}
Jun 01 06:16:47.533166 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76f50c6a-2fe0-4d1f-8005-9e4fd5041a85 req-c50a03d8-9a6b-4203-85fa-c7815cd167b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:47.534653 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-76f50c6a-2fe0-4d1f-8005-9e4fd5041a85 req-c50a03d8-9a6b-4203-85fa-c7815cd167b0 service neutron] 10.222.0.48 "GET /v2.0/networks?id=6200246e-b324-4384-a0a9-6dc6726e2c6d HTTP/1.1" status: 200  len: 910 time: 0.3505256
Jun 01 06:16:47.637470 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-ff6ecf9e-2ffd-44d9-a67f-ed2b7dee3cbd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:47.638926 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-ff6ecf9e-2ffd-44d9-a67f-ed2b7dee3cbd service neutron] 10.222.0.48 "GET /v2.0/subnets?id=27e7a9e0-ab4e-478c-aff2-55a26159dc84 HTTP/1.1" status: 200  len: 854 time: 0.1678548
Jun 01 06:16:47.704731 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-76f50c6a-2fe0-4d1f-8005-9e4fd5041a85 req-ea91b441-cc15-47bc-820a-319cfe95841f service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=6c07ed73-1eed-4e63-90ca-60843e890090 HTTP/1.1" status: 200  len: 1002 time: 0.1624379
Jun 01 06:16:47.781492 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 38480) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:16:47.797234 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76f50c6a-2fe0-4d1f-8005-9e4fd5041a85 req-2b4d59f4-2280-4aee-accf-6370fc35fcc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:47.798717 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-76f50c6a-2fe0-4d1f-8005-9e4fd5041a85 req-2b4d59f4-2280-4aee-accf-6370fc35fcc4 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=1fbcd64f-1378-4ec3-bd16-df65964c6028 HTTP/1.1" status: 200  len: 848 time: 0.0788341
Jun 01 06:16:47.805829 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-1895517e-a8ec-4b3b-bd6d-2e46fc702c7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:47.807771 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-1895517e-a8ec-4b3b-bd6d-2e46fc702c7b service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=d36c4486-6b2d-4439-996b-f13c04a98cb8&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1600072
Jun 01 06:16:47.928570 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-cb431a7e-a3fe-472f-9d96-27a3d7702510 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:47.946625 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-cb431a7e-a3fe-472f-9d96-27a3d7702510 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:16:47.950956 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-cb431a7e-a3fe-472f-9d96-27a3d7702510 admin admin] Usage tracker for resource:security_group_rule and tenant:28ce025b99174e939660919031f43c2a is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:16:47.954678 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-cb431a7e-a3fe-472f-9d96-27a3d7702510 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:16:47.961788 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-cb431a7e-a3fe-472f-9d96-27a3d7702510 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:16:48.022803 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76f50c6a-2fe0-4d1f-8005-9e4fd5041a85 req-10261c2a-edbe-4674-8f83-201af625a750 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:48.024701 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-76f50c6a-2fe0-4d1f-8005-9e4fd5041a85 req-10261c2a-edbe-4674-8f83-201af625a750 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=6200246e-b324-4384-a0a9-6dc6726e2c6d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2159061
Jun 01 06:16:48.029511 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-f3d3185d-5df2-454b-8a4c-52379b3e04c5 service neutron] 10.222.0.48 "GET /v2.0/networks/d36c4486-6b2d-4439-996b-f13c04a98cb8?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1827209
Jun 01 06:16:48.090038 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-cb431a7e-a3fe-472f-9d96-27a3d7702510 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:48.096801 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-cb431a7e-a3fe-472f-9d96-27a3d7702510 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:48.106817 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-65fb7265-e889-4f21-bc77-8762caf08695 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:48.150672 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb431a7e-a3fe-472f-9d96-27a3d7702510 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7f602ed6-6b5f-4794-8f16-aaf68a429cc9,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:48.154846 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-cb431a7e-a3fe-472f-9d96-27a3d7702510 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=28ce025b99174e939660919031f43c2a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3713768
Jun 01 06:16:48.161199 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 38486) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:16:48.165514 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb431a7e-a3fe-472f-9d96-27a3d7702510 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:48.165885 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb431a7e-a3fe-472f-9d96-27a3d7702510 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:48.166252 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb431a7e-a3fe-472f-9d96-27a3d7702510 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:48.166598 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb431a7e-a3fe-472f-9d96-27a3d7702510 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:48.166960 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb431a7e-a3fe-472f-9d96-27a3d7702510 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:48.167318 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb431a7e-a3fe-472f-9d96-27a3d7702510 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:48.167701 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb431a7e-a3fe-472f-9d96-27a3d7702510 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:48.168076 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb431a7e-a3fe-472f-9d96-27a3d7702510 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:48.168462 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb431a7e-a3fe-472f-9d96-27a3d7702510 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:48.168948 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb431a7e-a3fe-472f-9d96-27a3d7702510 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:48.169306 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb431a7e-a3fe-472f-9d96-27a3d7702510 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:48.169658 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb431a7e-a3fe-472f-9d96-27a3d7702510 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:16:48.182827 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-cb431a7e-a3fe-472f-9d96-27a3d7702510 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:48.250649 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8739397b-eccd-4f1d-8923-6f6e1a677a89 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:48.288762 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8739397b-eccd-4f1d-8923-6f6e1a677a89 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:48.323405 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0b5cc933-258b-4f18-afb1-19db0e28766a req-6c00e5c3-2402-4205-ad68-3af7ef7716f7 service neutron] 10.222.0.48 "GET /v2.0/networks/d36c4486-6b2d-4439-996b-f13c04a98cb8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2471821
Jun 01 06:16:48.329461 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-76f50c6a-2fe0-4d1f-8005-9e4fd5041a85 req-4ac152e1-5d85-4692-a7df-161a440de8cc service neutron] 10.222.0.48 "GET /v2.0/networks/6200246e-b324-4384-a0a9-6dc6726e2c6d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2849641
Jun 01 06:16:48.364301 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8739397b-eccd-4f1d-8923-6f6e1a677a89 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:48.370027 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-954337cc-c8b1-444c-9b06-b0748f7a44a9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:48.382356 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8739397b-eccd-4f1d-8923-6f6e1a677a89 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7f602ed6-6b5f-4794-8f16-aaf68a429cc9,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:48.387096 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-8739397b-eccd-4f1d-8923-6f6e1a677a89 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:48.393994 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8739397b-eccd-4f1d-8923-6f6e1a677a89 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:48.398306 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-8739397b-eccd-4f1d-8923-6f6e1a677a89 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/7f602ed6-6b5f-4794-8f16-aaf68a429cc9 HTTP/1.1" status: 204  len: 168 time: 0.2358975
Jun 01 06:16:48.675644 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-76f50c6a-2fe0-4d1f-8005-9e4fd5041a85 req-bde9fb36-292b-44ca-90b8-953ca94786db service neutron] 10.222.0.48 "GET /v2.0/networks/6200246e-b324-4384-a0a9-6dc6726e2c6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3371389
Jun 01 06:16:48.753061 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6005128a-818b-4734-bc3d-5786bc9e627f req-f04e0988-929c-4a46-9961-8713b3b9cb0f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:48.754598 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6005128a-818b-4734-bc3d-5786bc9e627f req-f04e0988-929c-4a46-9961-8713b3b9cb0f service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=c0ca2b878b874fe4af6e7b9fa8f6cf59&device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 1096 time: 0.3037124
Jun 01 06:16:48.769106 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e5352af-14c9-4185-89d7-cedef27331ec req-ee6a04e5-58d7-46bd-9c70-db5991f8a513 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:48.770711 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1e5352af-14c9-4185-89d7-cedef27331ec req-ee6a04e5-58d7-46bd-9c70-db5991f8a513 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 946 time: 0.2330060
Jun 01 06:16:49.027166 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1e5352af-14c9-4185-89d7-cedef27331ec req-654660c2-7c72-4982-9ab9-2c620effcddf tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2337434
Jun 01 06:16:49.075923 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecbeebcd-3e81-43c2-8fe6-3edd71713693 req-decb2f81-69bd-400c-982b-affa5b974367 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:49.077466 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ecbeebcd-3e81-43c2-8fe6-3edd71713693 req-decb2f81-69bd-400c-982b-affa5b974367 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 943 time: 0.3793607
Jun 01 06:16:49.082407 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6005128a-818b-4734-bc3d-5786bc9e627f req-93510642-6631-4d2f-922b-f7fe560ac8ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:49.083830 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6005128a-818b-4734-bc3d-5786bc9e627f req-93510642-6631-4d2f-922b-f7fe560ac8ef service neutron] 10.222.0.48 "GET /v2.0/networks?id=d36c4486-6b2d-4439-996b-f13c04a98cb8 HTTP/1.1" status: 200  len: 916 time: 0.3120110
Jun 01 06:16:49.172712 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6005128a-818b-4734-bc3d-5786bc9e627f req-57256ba3-328f-4411-aff9-7f6fc8ab9b46 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 HTTP/1.1" status: 200  len: 217 time: 0.0719745
Jun 01 06:16:49.224847 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ecbeebcd-3e81-43c2-8fe6-3edd71713693 req-79a8aa15-e1f7-4ae1-98b6-d068bed37580 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1400602
Jun 01 06:16:49.255203 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6005128a-818b-4734-bc3d-5786bc9e627f req-0e4dc0f1-3310-493c-b3ee-6198fb23d3e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:49.256686 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6005128a-818b-4734-bc3d-5786bc9e627f req-0e4dc0f1-3310-493c-b3ee-6198fb23d3e0 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=27e7a9e0-ab4e-478c-aff2-55a26159dc84 HTTP/1.1" status: 200  len: 854 time: 0.0717826
Jun 01 06:16:49.337781 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6005128a-818b-4734-bc3d-5786bc9e627f req-7c5775b3-2724-4a21-b753-78c99087626f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:49.339272 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6005128a-818b-4734-bc3d-5786bc9e627f req-7c5775b3-2724-4a21-b753-78c99087626f service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=d36c4486-6b2d-4439-996b-f13c04a98cb8&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0746276
Jun 01 06:16:49.481624 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6005128a-818b-4734-bc3d-5786bc9e627f req-c50a9973-683f-4567-8d22-d7cea34f0aa2 service neutron] 10.222.0.48 "GET /v2.0/networks/d36c4486-6b2d-4439-996b-f13c04a98cb8?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1343837
Jun 01 06:16:49.631367 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6005128a-818b-4734-bc3d-5786bc9e627f req-3339132c-8dde-4e61-8dab-aedcca89cf97 service neutron] 10.222.0.48 "GET /v2.0/networks/d36c4486-6b2d-4439-996b-f13c04a98cb8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1415691
Jun 01 06:16:50.219336 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35ef2f65-1e51-46d5-86fd-ba92e734a620 req-fa36995b-d0e7-48d7-8fc1-6d7941e6e9e2 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:50.220817 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-35ef2f65-1e51-46d5-86fd-ba92e734a620 req-fa36995b-d0e7-48d7-8fc1-6d7941e6e9e2 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 946 time: 0.0857723
Jun 01 06:16:50.272712 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-35ef2f65-1e51-46d5-86fd-ba92e734a620 req-3c0f018d-5bfd-4d34-866e-b629e1f69827 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0419602
Jun 01 06:16:50.487030 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e3c227c-5aa2-435d-bee0-108c1737a7f3 req-7c4e313b-cfb9-4954-a8a1-25389e47b8b8 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:50.488634 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9e3c227c-5aa2-435d-bee0-108c1737a7f3 req-7c4e313b-cfb9-4954-a8a1-25389e47b8b8 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 943 time: 0.1173422
Jun 01 06:16:50.538314 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9e3c227c-5aa2-435d-bee0-108c1737a7f3 req-83082bcb-c8cf-4d1f-a04e-6d037c997841 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0417793
Jun 01 06:16:51.476109 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-576b2858-f05c-40be-9cfd-d8de0b1a2d8b req-95f6e2dd-fff5-4df6-a257-b57382bc2b8e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:51.479052 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-576b2858-f05c-40be-9cfd-d8de0b1a2d8b req-95f6e2dd-fff5-4df6-a257-b57382bc2b8e tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 946 time: 0.0893881
Jun 01 06:16:51.538947 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-576b2858-f05c-40be-9cfd-d8de0b1a2d8b req-0d8e3154-70a2-4a2b-a652-568f9aba1330 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0539396
Jun 01 06:16:51.859102 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73ff436c-d59b-408e-a570-de0ffaa7de6a req-d078212e-9fbe-4a44-bab3-e2afe8ee1881 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:51.860628 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-73ff436c-d59b-408e-a570-de0ffaa7de6a req-d078212e-9fbe-4a44-bab3-e2afe8ee1881 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 943 time: 0.0859947
Jun 01 06:16:51.912777 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-73ff436c-d59b-408e-a570-de0ffaa7de6a req-799efafe-4a7c-4658-bc66-2a240ea5772c tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0461199
Jun 01 06:16:52.082292 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-da3ddfa1-eac3-4fcf-bf84-cab2453a7b3f req-6611476a-62da-41d2-a452-f36456017cad service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1353149
Jun 01 06:16:52.102752 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1223df94-391e-4a68-84b5-89ba6075f0cc req-aab5bb64-9ce6-42c2-9e3e-138d5cd4e20d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:52.104455 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1223df94-391e-4a68-84b5-89ba6075f0cc req-aab5bb64-9ce6-42c2-9e3e-138d5cd4e20d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 946 time: 0.1001337
Jun 01 06:16:52.156809 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1223df94-391e-4a68-84b5-89ba6075f0cc req-d28a3c01-e27d-4a5e-a857-52a7b34e57be tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0451772
Jun 01 06:16:52.552252 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:16:52.702571 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=8a7ac687-d801-4596-95ac-7b5a0bb4a7a7,segment=NetworkSegment(c40d74a4-eecc-4c63-8fd5-38ee39e77ccd),segment_id=c40d74a4-eecc-4c63-8fd5-38ee39e77ccd)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:16:52.718330 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': '8a7ac687-d801-4596-95ac-7b5a0bb4a7a7', 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8', 'port_id': '8a7ac687-d801-4596-95ac-7b5a0bb4a7a7', 'mac_address': 'fa:16:3e:10:8a:07', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 221, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '27e7a9e0-ab4e-478c-aff2-55a26159dc84', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:16:52.807434 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:52.829160 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:16:52.850288 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=8a7ac687-d801-4596-95ac-7b5a0bb4a7a7,segment=NetworkSegment(c40d74a4-eecc-4c63-8fd5-38ee39e77ccd),segment_id=c40d74a4-eecc-4c63-8fd5-38ee39e77ccd)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:16:52.853073 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:52.855090 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:52.922505 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=8a7ac687-d801-4596-95ac-7b5a0bb4a7a7,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:52.925700 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:53.115966 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['8a7ac687-d801-4596-95ac-7b5a0bb4a7a7'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:16:53.368990 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d4a5b0-bf66-491b-b9f0-169d9b6ccb3c req-102a0d32-e23c-401e-9761-79da6e8092bd tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:53.370448 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b4d4a5b0-bf66-491b-b9f0-169d9b6ccb3c req-102a0d32-e23c-401e-9761-79da6e8092bd tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 944 time: 0.1857359
Jun 01 06:16:53.429844 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ff9bfb0-1bd6-4a6b-9d3c-37722c2a5056 req-cffc9bdf-ce64-4946-b9d6-4e6044ccb230 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:53.431726 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3ff9bfb0-1bd6-4a6b-9d3c-37722c2a5056 req-cffc9bdf-ce64-4946-b9d6-4e6044ccb230 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 946 time: 0.1451437
Jun 01 06:16:53.441294 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b4d4a5b0-bf66-491b-b9f0-169d9b6ccb3c req-82d3ec64-dfe5-4326-adce-d2acd18da614 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0643587
Jun 01 06:16:53.496728 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3ff9bfb0-1bd6-4a6b-9d3c-37722c2a5056 req-2b921f09-0ae0-4d68-b1eb-725b3f10b1e2 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0542152
Jun 01 06:16:53.911904 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da3ddfa1-eac3-4fcf-bf84-cab2453a7b3f req-9709b9b9-c0da-4ea9-bea5-4b711d0cbfee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:53.913359 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-da3ddfa1-eac3-4fcf-bf84-cab2453a7b3f req-9709b9b9-c0da-4ea9-bea5-4b711d0cbfee service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f&tenant_id=60be617f683c42a081ab3f50c3bdf8f1 HTTP/1.1" status: 200  len: 1099 time: 0.0754466
Jun 01 06:16:54.015064 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da3ddfa1-eac3-4fcf-bf84-cab2453a7b3f req-7e211736-48ec-4f7d-ac94-4b852daaeef1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:54.016574 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-da3ddfa1-eac3-4fcf-bf84-cab2453a7b3f req-7e211736-48ec-4f7d-ac94-4b852daaeef1 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=60be617f683c42a081ab3f50c3bdf8f1&device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 1099 time: 0.0796032
Jun 01 06:16:54.257159 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da3ddfa1-eac3-4fcf-bf84-cab2453a7b3f req-bcb73357-193a-4d5f-87b5-b2d08ba5e082 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:54.259764 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-da3ddfa1-eac3-4fcf-bf84-cab2453a7b3f req-bcb73357-193a-4d5f-87b5-b2d08ba5e082 service neutron] 10.222.0.48 "GET /v2.0/networks?id=6200246e-b324-4384-a0a9-6dc6726e2c6d HTTP/1.1" status: 200  len: 910 time: 0.2362127
Jun 01 06:16:54.378062 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-da3ddfa1-eac3-4fcf-bf84-cab2453a7b3f req-e56782fa-f6cf-451e-bd8c-f766e7d5cdeb service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=6c07ed73-1eed-4e63-90ca-60843e890090 HTTP/1.1" status: 200  len: 1002 time: 0.1054766
Jun 01 06:16:54.449137 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da3ddfa1-eac3-4fcf-bf84-cab2453a7b3f req-a45355c8-9849-406a-a9be-482a045b9eb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:54.450604 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-da3ddfa1-eac3-4fcf-bf84-cab2453a7b3f req-a45355c8-9849-406a-a9be-482a045b9eb4 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=1fbcd64f-1378-4ec3-bd16-df65964c6028 HTTP/1.1" status: 200  len: 848 time: 0.0635886
Jun 01 06:16:54.530973 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da3ddfa1-eac3-4fcf-bf84-cab2453a7b3f req-220b04e2-5ea9-4d9e-90ae-e7f203f22b20 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:54.532543 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-da3ddfa1-eac3-4fcf-bf84-cab2453a7b3f req-220b04e2-5ea9-4d9e-90ae-e7f203f22b20 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=6200246e-b324-4384-a0a9-6dc6726e2c6d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0750759
Jun 01 06:16:54.559884 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:16:54.637666 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning for port 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:16:54.645436 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:16:54.645825 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:54.771090 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:54.804895 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-da3ddfa1-eac3-4fcf-bf84-cab2453a7b3f req-2dcdb365-a3aa-4afb-aac9-9b104a0c249c service neutron] 10.222.0.48 "GET /v2.0/networks/6200246e-b324-4384-a0a9-6dc6726e2c6d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2610662
Jun 01 06:16:54.805133 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5f919b7d-49a2-4b7d-bab0-b076bda23370', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8a7ac687-d801-4596-95ac-7b5a0bb4a7a7'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:16:54.805556 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f8fad2a9-2c8e-4c70-8c94-74f249a945b5" -d '{"events": [{"server_uuid": "5f919b7d-49a2-4b7d-bab0-b076bda23370", "name": "network-vif-plugged", "status": "completed", "tag": "8a7ac687-d801-4596-95ac-7b5a0bb4a7a7"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:16:54.816188 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=8a7ac687-d801-4596-95ac-7b5a0bb4a7a7,segment=NetworkSegment(c40d74a4-eecc-4c63-8fd5-38ee39e77ccd),segment_id=c40d74a4-eecc-4c63-8fd5-38ee39e77ccd)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:16:54.820858 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:54.822043 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 6c07ed73-1eed-4e63-90ca-60843e890090 no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:16:54.838829 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-681a43de-b9f9-4993-8365-ddea804931d6 req-170e8571-c685-4ee8-b7d7-0092bc83861d tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:54.840348 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-681a43de-b9f9-4993-8365-ddea804931d6 req-170e8571-c685-4ee8-b7d7-0092bc83861d tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 944 time: 0.2716179
Jun 01 06:16:54.851167 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:54.859191 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757f0d89-dcff-4757-a797-d3778646fca8 req-a4a19c69-d109-4a34-85fe-bf2badf3aa80 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:54.860698 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-757f0d89-dcff-4757-a797-d3778646fca8 req-a4a19c69-d109-4a34-85fe-bf2badf3aa80 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 946 time: 0.2497976
Jun 01 06:16:54.946607 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=8a7ac687-d801-4596-95ac-7b5a0bb4a7a7,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:54.950221 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:55.013069 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-681a43de-b9f9-4993-8365-ddea804931d6 req-82a7c68c-eca0-4cb1-90da-1a854207fd68 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1647804
Jun 01 06:16:55.013341 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:55.019608 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-757f0d89-dcff-4757-a797-d3778646fca8 req-a40adca5-86d2-4131-a3c8-70a385e12713 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1041965
Jun 01 06:16:55.043022 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-da3ddfa1-eac3-4fcf-bf84-cab2453a7b3f req-d6c9f355-e6c7-400e-8427-b1837147808c service neutron] 10.222.0.48 "GET /v2.0/networks/6200246e-b324-4384-a0a9-6dc6726e2c6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2315948
Jun 01 06:16:55.050890 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 6c07ed73-1eed-4e63-90ca-60843e890090, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=6c07ed73-1eed-4e63-90ca-60843e890090,segment=NetworkSegment(fd926c6b-9e42-4104-afe3-51ec344ecdd5),segment_id=fd926c6b-9e42-4104-afe3-51ec344ecdd5)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:16:55.057568 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:16:55.059525 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-2033a930-f571-4414-b5dc-61eac012953b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:16:55.133864 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=6c07ed73-1eed-4e63-90ca-60843e890090,revision_number=6']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:16:55.137240 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:16:55.151038 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:16:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a5f57bbc-6cad-450c-9c72-2db9f18cc1ed x-openstack-request-id: req-a5f57bbc-6cad-450c-9c72-2db9f18cc1ed {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:16:55.151335 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5f919b7d-49a2-4b7d-bab0-b076bda23370", "name": "network-vif-plugged", "status": "completed", "tag": "8a7ac687-d801-4596-95ac-7b5a0bb4a7a7", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:16:55.151624 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-a5f57bbc-6cad-450c-9c72-2db9f18cc1ed {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:16:55.152031 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5f919b7d-49a2-4b7d-bab0-b076bda23370', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8a7ac687-d801-4596-95ac-7b5a0bb4a7a7', 'code': 200}
Jun 01 06:16:55.388063 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2d42720-4d30-42bd-99c0-183dcfa1e116 req-d5df28f1-b6da-46cf-b327-0dc8362d0fa5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:55.389441 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a2d42720-4d30-42bd-99c0-183dcfa1e116 req-d5df28f1-b6da-46cf-b327-0dc8362d0fa5 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 1098 time: 0.0696816
Jun 01 06:16:55.449686 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a2d42720-4d30-42bd-99c0-183dcfa1e116 req-30dcb5a2-3088-40c1-997b-4fe588eb68c5 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0531356
Jun 01 06:16:56.280674 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-002fe5dc-8222-4afd-8bed-2141086efabd req-dc7f32d4-285b-4d57-9aee-c87e829a2501 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:56.282168 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-002fe5dc-8222-4afd-8bed-2141086efabd req-dc7f32d4-285b-4d57-9aee-c87e829a2501 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 944 time: 0.1450002
Jun 01 06:16:56.292857 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e94cd80-9bd4-4441-a944-ccb47edc3098 req-a24a4f16-56a8-41a4-97ad-c270ffe90878 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:56.294316 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8e94cd80-9bd4-4441-a944-ccb47edc3098 req-a24a4f16-56a8-41a4-97ad-c270ffe90878 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 945 time: 0.1255093
Jun 01 06:16:56.367181 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-002fe5dc-8222-4afd-8bed-2141086efabd req-f7d05037-1c80-492d-9187-5cf0e9241c31 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0718045
Jun 01 06:16:56.370345 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8e94cd80-9bd4-4441-a944-ccb47edc3098 req-115d24e9-9a6c-46b8-886d-4b14a78c6a90 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0615542
Jun 01 06:16:57.153481 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a8503e6f-cd18-456e-9b8d-c60b093a7c7f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '6c07ed73-1eed-4e63-90ca-60843e890090'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:16:57.155797 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6b1b958a-0a49-4dfd-894d-e1a78adf7027" -d '{"events": [{"server_uuid": "a8503e6f-cd18-456e-9b8d-c60b093a7c7f", "name": "network-vif-unplugged", "status": "completed", "tag": "6c07ed73-1eed-4e63-90ca-60843e890090"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:16:57.205361 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 01 Jun 2021 06:16:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a063a8bd-3809-4af7-aad2-2fe5ac5eea4b x-openstack-request-id: req-a063a8bd-3809-4af7-aad2-2fe5ac5eea4b {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:16:57.205671 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a8503e6f-cd18-456e-9b8d-c60b093a7c7f", "name": "network-vif-unplugged", "status": "completed", "tag": "6c07ed73-1eed-4e63-90ca-60843e890090", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:16:57.205930 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-a063a8bd-3809-4af7-aad2-2fe5ac5eea4b {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:16:57.206323 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a8503e6f-cd18-456e-9b8d-c60b093a7c7f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '6c07ed73-1eed-4e63-90ca-60843e890090', 'code': 200}
Jun 01 06:16:57.626710 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d15475-dcc5-4e27-a908-0f5b110e2811 req-4e18a248-b799-48e7-bc1b-321766fb8095 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:57.628231 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e5d15475-dcc5-4e27-a908-0f5b110e2811 req-4e18a248-b799-48e7-bc1b-321766fb8095 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 944 time: 0.1481702
Jun 01 06:16:57.641847 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d915579-e925-4a3b-955f-79af5a5c2e7e req-b0ba42cf-cefd-4f37-b2a9-e191d7da125a tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:57.643534 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3d915579-e925-4a3b-955f-79af5a5c2e7e req-b0ba42cf-cefd-4f37-b2a9-e191d7da125a tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 945 time: 0.1308351
Jun 01 06:16:57.718335 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e5d15475-dcc5-4e27-a908-0f5b110e2811 req-c0fe4648-46fa-4277-bcd8-adfa18c1ef43 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0737126
Jun 01 06:16:57.722674 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3d915579-e925-4a3b-955f-79af5a5c2e7e req-544a36ca-69da-46c4-8a9e-8130d0803879 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0616534
Jun 01 06:16:58.024883 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aab56c24-72c8-4bf6-95c7-ce283c0e2858 req-5d2cf61f-7178-4697-bb10-d00dbf42aa5b tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:58.026248 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-aab56c24-72c8-4bf6-95c7-ce283c0e2858 req-5d2cf61f-7178-4697-bb10-d00dbf42aa5b tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 945 time: 0.0840192
Jun 01 06:16:58.083252 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-aab56c24-72c8-4bf6-95c7-ce283c0e2858 req-d5020c14-8336-49ee-8278-c9a420b5ea08 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0512061
Jun 01 06:16:58.487095 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a962b2e4-60ad-44e9-9434-537ffd4b0eba req-1680fb85-6ee7-4143-93c3-a68014ea03d9 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:58.488561 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a962b2e4-60ad-44e9-9434-537ffd4b0eba req-1680fb85-6ee7-4143-93c3-a68014ea03d9 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 945 time: 0.0851324
Jun 01 06:16:58.534439 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a962b2e4-60ad-44e9-9434-537ffd4b0eba req-877f371b-6969-454e-9790-e5733b1bdf75 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398979
Jun 01 06:16:58.928796 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3308e9-9bb6-4944-be44-faa628960b97 req-96253ecf-3fd9-42da-b97a-089a2c8fc662 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:16:58.930384 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4b3308e9-9bb6-4944-be44-faa628960b97 req-96253ecf-3fd9-42da-b97a-089a2c8fc662 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 944 time: 0.1019821
Jun 01 06:16:58.979323 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4b3308e9-9bb6-4944-be44-faa628960b97 req-4d2ad8ed-5207-4e42-a05e-7eebb20ca582 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0417938
Jun 01 06:17:00.182057 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b53e7067-5f82-4059-b23b-a8af59f3569f req-b750dc12-2a15-48f0-a9c2-848434f38524 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:00.183553 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b53e7067-5f82-4059-b23b-a8af59f3569f req-b750dc12-2a15-48f0-a9c2-848434f38524 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 944 time: 0.0850093
Jun 01 06:17:00.327643 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b53e7067-5f82-4059-b23b-a8af59f3569f req-4b2281f7-39e9-47f2-9cdf-3d0e7965ad04 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1377733
Jun 01 06:17:01.572787 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dd3208b-37d8-4aa0-9e68-6373cedb9655 req-c45e45c9-ffea-4536-a7bf-7745d753f250 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:01.574575 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7dd3208b-37d8-4aa0-9e68-6373cedb9655 req-c45e45c9-ffea-4536-a7bf-7745d753f250 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 1097 time: 0.1407948
Jun 01 06:17:01.602561 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a97032cc-1231-4df0-b24e-55f6d1fc1f55 req-f2cd9ae4-bdd6-41b2-8b1a-4375845e3357 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:01.604846 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a97032cc-1231-4df0-b24e-55f6d1fc1f55 req-f2cd9ae4-bdd6-41b2-8b1a-4375845e3357 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 944 time: 0.1389883
Jun 01 06:17:01.662528 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7dd3208b-37d8-4aa0-9e68-6373cedb9655 req-cde9dd56-4916-4c3d-851a-497f428c4a92 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0807793
Jun 01 06:17:01.671534 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a97032cc-1231-4df0-b24e-55f6d1fc1f55 req-59dbcec3-597e-4764-a685-aa30f0e76b34 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0610549
Jun 01 06:17:02.720751 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:17:02.872379 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ae056c2-b34b-4826-b0e2-6f63f97dad82 req-a28a3c36-7213-414b-b597-dc6d47220cd3 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:02.873865 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0ae056c2-b34b-4826-b0e2-6f63f97dad82 req-a28a3c36-7213-414b-b597-dc6d47220cd3 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 944 time: 0.0907459
Jun 01 06:17:02.922948 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0ae056c2-b34b-4826-b0e2-6f63f97dad82 req-4725222d-0500-4898-8b7e-b7694ba2ceaa tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0426888
Jun 01 06:17:04.604478 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 6c07ed73-1eed-4e63-90ca-60843e890090 details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:17:04.753066 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 6c07ed73-1eed-4e63-90ca-60843e890090, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=6c07ed73-1eed-4e63-90ca-60843e890090,segment=NetworkSegment(fd926c6b-9e42-4104-afe3-51ec344ecdd5),segment_id=fd926c6b-9e42-4104-afe3-51ec344ecdd5)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:17:04.767398 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': '6c07ed73-1eed-4e63-90ca-60843e890090', 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d', 'port_id': '6c07ed73-1eed-4e63-90ca-60843e890090', 'mac_address': 'fa:16:3e:21:61:09', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 222, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1fbcd64f-1378-4ec3-bd16-df65964c6028', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:17:04.828511 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:04.847516 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6c07ed73-1eed-4e63-90ca-60843e890090 {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:17:04.864733 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 6c07ed73-1eed-4e63-90ca-60843e890090, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=6c07ed73-1eed-4e63-90ca-60843e890090,segment=NetworkSegment(fd926c6b-9e42-4104-afe3-51ec344ecdd5),segment_id=fd926c6b-9e42-4104-afe3-51ec344ecdd5)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:17:04.870598 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:04.873428 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:05.019000 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=6c07ed73-1eed-4e63-90ca-60843e890090,revision_number=7']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:05.030712 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:05.031045 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:05.031427 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:05.031750 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:05.032098 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:05.032416 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:05.032722 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:05.033034 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:05.033340 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:05.033657 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:05.033959 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:05.034264 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:05.038264 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:05.114405 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['6c07ed73-1eed-4e63-90ca-60843e890090'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:17:06.614019 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 6c07ed73-1eed-4e63-90ca-60843e890090 up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:17:06.684425 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port 6c07ed73-1eed-4e63-90ca-60843e890090 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:17:06.684788 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:06.801181 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:06.829200 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a8503e6f-cd18-456e-9b8d-c60b093a7c7f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6c07ed73-1eed-4e63-90ca-60843e890090'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:17:06.831435 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f4d0a7b0-6278-4da4-9889-47d04070cc73" -d '{"events": [{"server_uuid": "a8503e6f-cd18-456e-9b8d-c60b093a7c7f", "name": "network-vif-plugged", "status": "completed", "tag": "6c07ed73-1eed-4e63-90ca-60843e890090"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:17:06.840267 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 6c07ed73-1eed-4e63-90ca-60843e890090, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=6c07ed73-1eed-4e63-90ca-60843e890090,segment=NetworkSegment(fd926c6b-9e42-4104-afe3-51ec344ecdd5),segment_id=fd926c6b-9e42-4104-afe3-51ec344ecdd5)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:17:06.844925 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:06.847957 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-314174fd-c027-485f-84e5-d1cbcc7e71fb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:06.885245 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:17:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d231c287-671b-4993-9eca-e68d41569932 x-openstack-request-id: req-d231c287-671b-4993-9eca-e68d41569932 {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:17:06.885893 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a8503e6f-cd18-456e-9b8d-c60b093a7c7f", "name": "network-vif-plugged", "status": "completed", "tag": "6c07ed73-1eed-4e63-90ca-60843e890090", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:17:06.886153 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-d231c287-671b-4993-9eca-e68d41569932 {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:17:06.886546 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a8503e6f-cd18-456e-9b8d-c60b093a7c7f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6c07ed73-1eed-4e63-90ca-60843e890090', 'code': 200}
Jun 01 06:17:06.927668 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=6c07ed73-1eed-4e63-90ca-60843e890090,revision_number=8']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:06.930696 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:07.946751 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-170104e5-1c6a-4c68-8f6e-467f50e7ac36 req-8f6ba5fd-894e-478a-a2fd-b4f09ba795e3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:07.948774 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-170104e5-1c6a-4c68-8f6e-467f50e7ac36 req-8f6ba5fd-894e-478a-a2fd-b4f09ba795e3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 945 time: 0.1130421
Jun 01 06:17:07.956149 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45167b84-ecd0-43b0-9e8a-8e59c0cd21b0 req-b980ac8a-3add-4942-b66d-cbfd0fb7aeca tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:07.957496 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-45167b84-ecd0-43b0-9e8a-8e59c0cd21b0 req-b980ac8a-3add-4942-b66d-cbfd0fb7aeca tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 945 time: 0.1533549
Jun 01 06:17:08.026928 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-170104e5-1c6a-4c68-8f6e-467f50e7ac36 req-4ca5003f-5d4d-4689-94a8-4fe7c59f05a0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0684114
Jun 01 06:17:08.031276 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-45167b84-ecd0-43b0-9e8a-8e59c0cd21b0 req-e9352d43-9b9e-42ed-aaa5-be766858ba70 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0588531
Jun 01 06:17:08.049654 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 38686) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:08.335890 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-a0ff9bb5-ce9a-4755-bff3-6c411df6c280 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:08.412939 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2d9148b1-77f8-4c50-a6b3-9a5d7bb70e80 tempest-TestMinimumBasicScenario-1623308868 tempest-TestMinimumBasicScenario-1623308868-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:08.413651 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-2d9148b1-77f8-4c50-a6b3-9a5d7bb70e80 tempest-TestMinimumBasicScenario-1623308868 tempest-TestMinimumBasicScenario-1623308868-project-admin] Synchronizing usage tracker for tenant:43f56027f58d47f5b11d46a512f3e137 on resource:port {{(pid=92230) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:17:08.430573 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-2d9148b1-77f8-4c50-a6b3-9a5d7bb70e80 tempest-TestMinimumBasicScenario-1623308868 tempest-TestMinimumBasicScenario-1623308868-project-admin] Unset dirty status for tenant:43f56027f58d47f5b11d46a512f3e137 on resource:port {{(pid=92230) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:17:08.435585 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-2d9148b1-77f8-4c50-a6b3-9a5d7bb70e80 tempest-TestMinimumBasicScenario-1623308868 tempest-TestMinimumBasicScenario-1623308868-project-admin] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 1093 time: 0.3810873
Jun 01 06:17:08.436168 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 38696) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:08.442560 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Request body: {'floatingip': {'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'port_id': '8a7ac687-d801-4596-95ac-7b5a0bb4a7a7', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'fixed_ip_address': '172.20.0.3'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:17:08.448553 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:17:08.453124 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Usage tracker for resource:floatingip and tenant:c0ca2b878b874fe4af6e7b9fa8f6cf59 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:17:08.455992 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:17:08.461616 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:17:08.472729 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for floatingip, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:08.627629 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:08.798160 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_common [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Allocated IP 172.27.2.155 (83b812fb-2cfc-46e4-baa4-745218ea3ed2/a59d7d11-a92c-4b4f-83cf-2095ecee2b51/f9f8734a-9237-43bc-92cd-2cbe6695bb5b) {{(pid=92230) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:17:08.951228 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for port, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:08.962054 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bfe8bf4-43c7-4bc9-b7b4-28cba97ea902 req-bfb558d3-168d-487a-ac02-a5e87b3b5531 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:08.963583 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7bfe8bf4-43c7-4bc9-b7b4-28cba97ea902 req-bfb558d3-168d-487a-ac02-a5e87b3b5531 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 946 time: 0.0835001
Jun 01 06:17:08.982448 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:08.987508 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-832e318f-8561-42d0-b189-40eba2d69318 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:09.013183 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7bfe8bf4-43c7-4bc9-b7b4-28cba97ea902 req-0ddd6ea2-268c-47f0-9fd0-1cfc83ebbbf7 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0435324
Jun 01 06:17:09.050391 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:17:09.053259 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:17:09.056676 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Received port after_create {{(pid=92230) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:17:09.090736 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Pushing event updated for resources: {'Port': ['ID=f9f8734a-9237-43bc-92cd-2cbe6695bb5b,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:09.094823 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:09.231187 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23b38815-9e97-4b09-b7e9-7e0a035c6a2c req-5739bf00-80aa-4af5-9b20-b8875020e4fc tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:09.232601 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-23b38815-9e97-4b09-b7e9-7e0a035c6a2c req-5739bf00-80aa-4af5-9b20-b8875020e4fc tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 945 time: 0.0822067
Jun 01 06:17:09.277145 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-23b38815-9e97-4b09-b7e9-7e0a035c6a2c req-448b1dcb-45c7-4258-b901-cb3103331d91 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0388210
Jun 01 06:17:09.506380 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:09.587610 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:09.800989 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for port, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:09.806541 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2416196'] for port, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:09.812525 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:09.923895 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Pushing event updated for resources: {'Port': ['ID=f9f8734a-9237-43bc-92cd-2cbe6695bb5b,revision_number=2']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:09.927833 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:09.935883 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-745720'] for floatingip, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:10.221838 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.db.l3_db [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Floating IP 1945cc30-f010-48ee-8395-8f1719cf31be associated. External IP: 172.27.2.155, port: 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7.
Jun 01 06:17:10.263334 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dc2c3ef-72dc-4a8d-8ff3-171993d76330 req-16fc194d-4e69-4901-bb4c-d7aee6d4cc59 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:10.264950 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4dc2c3ef-72dc-4a8d-8ff3-171993d76330 req-16fc194d-4e69-4901-bb4c-d7aee6d4cc59 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 946 time: 0.1338716
Jun 01 06:17:10.332420 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4dc2c3ef-72dc-4a8d-8ff3-171993d76330 req-b82a2a28-4f2d-441d-8cce-c6b8d6375a09 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0593657
Jun 01 06:17:10.546540 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43f611c7-a77a-41ec-863f-f4ca83b006fd req-73fd2fb2-ecf4-4524-9a9e-3f3681f5d1be tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:10.548008 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-43f611c7-a77a-41ec-863f-f4ca83b006fd req-73fd2fb2-ecf4-4524-9a9e-3f3681f5d1be tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 945 time: 0.1361961
Jun 01 06:17:10.603698 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Router 4b9daac3-8875-4acd-af69-09a389effcf9 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92230) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:17:10.604732 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-43f611c7-a77a-41ec-863f-f4ca83b006fd req-656edcec-f984-4b9f-97a3-3a0aaf97b844 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0496604
Jun 01 06:17:10.612911 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb929459-b8b5-4b85-a1c3-db538dfa46de req-e3d7540c-a1a9-4b75-b923-f7d95934ce07 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:10.614315 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bb929459-b8b5-4b85-a1c3-db538dfa46de req-e3d7540c-a1a9-4b75-b923-f7d95934ce07 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.48 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 946 time: 0.1354065
Jun 01 06:17:10.764084 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-bb929459-b8b5-4b85-a1c3-db538dfa46de req-4adfe048-cf2b-4fb6-8b1d-ae83a3c4b24a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Deleting port 7d7451f5-3439-4d43-8bf7-ac121c8931c4 {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:17:10.764423 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-bb929459-b8b5-4b85-a1c3-db538dfa46de req-4adfe048-cf2b-4fb6-8b1d-ae83a3c4b24a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:10.786932 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:17:10.802943 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1929c552-400d-4e4b-9a0f-2816e45f0b94 None None] Sync routers for ids ['4b9daac3-8875-4acd-af69-09a389effcf9'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:17:10.813927 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for floatingip, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:10.817441 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1929c552-400d-4e4b-9a0f-2816e45f0b94 None None] Routers {'4b9daac3-8875-4acd-af69-09a389effcf9'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:17:10.818062 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-1929c552-400d-4e4b-9a0f-2816e45f0b94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b225e400>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:16:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['4b9daac3-8875-4acd-af69-09a389effcf9'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:10.890760 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 2.4506705
Jun 01 06:17:10.890760 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5f919b7d-49a2-4b7d-bab0-b076bda23370', 'tag': '8a7ac687-d801-4596-95ac-7b5a0bb4a7a7'}] {{(pid=92230) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:17:10.891210 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a8971187fdc179bafebfda031591b22633150c3ea1d9449252a7819502f19756" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5b4eedec-8d7f-448d-b23c-2edb3923b2b1" -d '{"events": [{"name": "network-changed", "server_uuid": "5f919b7d-49a2-4b7d-bab0-b076bda23370", "tag": "8a7ac687-d801-4596-95ac-7b5a0bb4a7a7"}]}' {{(pid=92230) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:17:10.891656 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 38726) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:10.907553 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-b5f60870-ce64-4c01-a683-862441fb77bb tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1799299822', 'description': 'tempest-secgroup-smoke-1799299822 description', 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:17:10.918179 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-b5f60870-ce64-4c01-a683-862441fb77bb tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:17:10.925906 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-bb929459-b8b5-4b85-a1c3-db538dfa46de req-4adfe048-cf2b-4fb6-8b1d-ae83a3c4b24a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] For port 7d7451f5-3439-4d43-8bf7-ac121c8931c4, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=7d7451f5-3439-4d43-8bf7-ac121c8931c4,segment=NetworkSegment(e9a368be-e119-4f56-bdcc-b9d10543e0d8),segment_id=e9a368be-e119-4f56-bdcc-b9d10543e0d8)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:17:10.926261 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-bb929459-b8b5-4b85-a1c3-db538dfa46de req-4adfe048-cf2b-4fb6-8b1d-ae83a3c4b24a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:10.934649 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-b5f60870-ce64-4c01-a683-862441fb77bb tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Usage tracker for resource:security_group and tenant:c0ca2b878b874fe4af6e7b9fa8f6cf59 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:17:10.940241 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-b5f60870-ce64-4c01-a683-862441fb77bb tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:17:10.995100 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-b5f60870-ce64-4c01-a683-862441fb77bb tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:17:11.002313 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:17:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e1196637-62cf-417b-82a5-898353f678d8 x-openstack-request-id: req-e1196637-62cf-417b-82a5-898353f678d8 {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:17:11.002642 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5f919b7d-49a2-4b7d-bab0-b076bda23370", "tag": "8a7ac687-d801-4596-95ac-7b5a0bb4a7a7", "status": "completed", "code": 200}]} {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:17:11.002930 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-e1196637-62cf-417b-82a5-898353f678d8 {{(pid=92230) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:17:11.003744 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5f919b7d-49a2-4b7d-bab0-b076bda23370', 'tag': '8a7ac687-d801-4596-95ac-7b5a0bb4a7a7', 'status': 'completed', 'code': 200}
Jun 01 06:17:11.027806 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-1929c552-400d-4e4b-9a0f-2816e45f0b94 None None] Set router 4b9daac3-8875-4acd-af69-09a389effcf9 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:17:11.071401 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b5f60870-ce64-4c01-a683-862441fb77bb tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:11.178091 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-b5f60870-ce64-4c01-a683-862441fb77bb tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:17:11.191840 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-b5f60870-ce64-4c01-a683-862441fb77bb tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Usage tracker for resource:security_group_rule and tenant:c0ca2b878b874fe4af6e7b9fa8f6cf59 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:17:11.201742 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-b5f60870-ce64-4c01-a683-862441fb77bb tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:17:11.214157 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-b5f60870-ce64-4c01-a683-862441fb77bb tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:17:11.289222 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:11.417876 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-1929c552-400d-4e4b-9a0f-2816e45f0b94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b225e400>, [{'id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'name': 'tempest-TestMinimumBasicScenario-2100526911-router', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54'}], 'enable_snat': True}, 'gw_port_id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:15:55Z', 'updated_at': '2021-06-01T06:16:02Z', 'revision_number': 4, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'gw_port': {'id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:16:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:15:56Z', 'updated_at': '2021-06-01T06:16:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '1945cc30-f010-48ee-8395-8f1719cf31be', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'floating_ip_address': '172.27.2.155', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'port_id': '8a7ac687-d801-4596-95ac-7b5a0bb4a7a7', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 570, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8', 'mac_address': 'fa:16:3e:10:8a:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f919b7d-49a2-4b7d-bab0-b076bda23370', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:17:09Z', 'updated_at': '2021-06-01T06:17:09Z', 'revision_number': 0, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ac9595c2-fb73-47ad-a4a7-a8318ad01d8c', 'name': '', 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'mac_address': 'fa:16:3e:a7:87:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'device_owner': 'network:router_interface', 'standard_attr_id': 537, 'fixed_ips': [{'subnet_id': '27e7a9e0-ab4e-478c-aff2-55a26159dc84', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:16:01Z', 'updated_at': '2021-06-01T06:16:08Z', 'revision_number': 5, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'subnets': [{'id': '27e7a9e0-ab4e-478c-aff2-55a26159dc84', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:11.423282 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1929c552-400d-4e4b-9a0f-2816e45f0b94 None None] Checking router: 4b9daac3-8875-4acd-af69-09a389effcf9 for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:17:11.438863 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1929c552-400d-4e4b-9a0f-2816e45f0b94 None None] Routers {'4b9daac3-8875-4acd-af69-09a389effcf9'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:17:11.439875 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-1929c552-400d-4e4b-9a0f-2816e45f0b94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b225e400>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:16:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['4b9daac3-8875-4acd-af69-09a389effcf9'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:11.444269 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b4eedec-8d7f-448d-b23c-2edb3923b2b1 req-24f20b4c-db0f-4b2b-a3fb-4db65ade63ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:11.445766 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5b4eedec-8d7f-448d-b23c-2edb3923b2b1 req-24f20b4c-db0f-4b2b-a3fb-4db65ade63ce service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=c0ca2b878b874fe4af6e7b9fa8f6cf59&device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 1098 time: 0.4131191
Jun 01 06:17:11.524219 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-bb929459-b8b5-4b85-a1c3-db538dfa46de req-4adfe048-cf2b-4fb6-8b1d-ae83a3c4b24a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:11.524587 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-bb929459-b8b5-4b85-a1c3-db538dfa46de req-4adfe048-cf2b-4fb6-8b1d-ae83a3c4b24a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-745720'] for floatingip, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:11.524897 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.db.l3_db [req-bb929459-b8b5-4b85-a1c3-db538dfa46de req-4adfe048-cf2b-4fb6-8b1d-ae83a3c4b24a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Floating IP 4c6a9e9d-ea2e-4346-a164-98d7263ff8aa disassociated. External IP: 172.27.2.191, port: 7d7451f5-3439-4d43-8bf7-ac121c8931c4.
Jun 01 06:17:11.525238 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-bb929459-b8b5-4b85-a1c3-db538dfa46de req-4adfe048-cf2b-4fb6-8b1d-ae83a3c4b24a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Calling delete_port for 7d7451f5-3439-4d43-8bf7-ac121c8931c4 owned by compute:nova {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:17:11.626089 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-1929c552-400d-4e4b-9a0f-2816e45f0b94 None None] Set router 4b9daac3-8875-4acd-af69-09a389effcf9 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:17:11.680008 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b5f60870-ce64-4c01-a683-862441fb77bb tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:11.692658 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b5f60870-ce64-4c01-a683-862441fb77bb tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:11.701650 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:11.788692 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b4eedec-8d7f-448d-b23c-2edb3923b2b1 req-75f4aed5-4a41-47cc-b4eb-43123cf5bd00 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:11.790137 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5b4eedec-8d7f-448d-b23c-2edb3923b2b1 req-75f4aed5-4a41-47cc-b4eb-43123cf5bd00 service neutron] 10.222.0.48 "GET /v2.0/networks?id=d36c4486-6b2d-4439-996b-f13c04a98cb8 HTTP/1.1" status: 200  len: 916 time: 0.3341336
Jun 01 06:17:11.809741 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eaab361-9cf6-48ee-b27a-577279dab3db req-92274ece-bb81-486a-9adf-91f2bd6bfb58 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:11.811514 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7eaab361-9cf6-48ee-b27a-577279dab3db req-92274ece-bb81-486a-9adf-91f2bd6bfb58 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 946 time: 0.3543644
Jun 01 06:17:11.890742 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b5f60870-ce64-4c01-a683-862441fb77bb tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:11.891994 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-b5f60870-ce64-4c01-a683-862441fb77bb tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.9991157
Jun 01 06:17:11.892772 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5f60870-ce64-4c01-a683-862441fb77bb tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8b6148b9-b790-4563-ad28-9c548198b033,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:11.895337 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 38740) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:11.907151 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-d57a9e0b-9f4d-4e88-b6d9-23b4c73d746f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Request body: {'security_group_rule': {'security_group_id': '8b6148b9-b790-4563-ad28-9c548198b033', 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:17:11.914600 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-d57a9e0b-9f4d-4e88-b6d9-23b4c73d746f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:17:11.919654 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-d57a9e0b-9f4d-4e88-b6d9-23b4c73d746f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Usage tracker for resource:security_group_rule and tenant:c0ca2b878b874fe4af6e7b9fa8f6cf59 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:17:11.922175 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b5f60870-ce64-4c01-a683-862441fb77bb tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.220s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:11.922860 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-d57a9e0b-9f4d-4e88-b6d9-23b4c73d746f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:17:11.930110 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-d57a9e0b-9f4d-4e88-b6d9-23b4c73d746f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:17:11.949406 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d57a9e0b-9f4d-4e88-b6d9-23b4c73d746f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.021764 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d57a9e0b-9f4d-4e88-b6d9-23b4c73d746f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.026510 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d57a9e0b-9f4d-4e88-b6d9-23b4c73d746f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.035006 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5b4eedec-8d7f-448d-b23c-2edb3923b2b1 req-05461049-3e3a-4dc5-9a7f-d66b5be72cb4 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 HTTP/1.1" status: 200  len: 999 time: 0.2224755
Jun 01 06:17:12.042092 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-1929c552-400d-4e4b-9a0f-2816e45f0b94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b225e400>, [{'id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'name': 'tempest-TestMinimumBasicScenario-2100526911-router', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54'}], 'enable_snat': True}, 'gw_port_id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:15:55Z', 'updated_at': '2021-06-01T06:16:02Z', 'revision_number': 4, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'gw_port': {'id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:16:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:15:56Z', 'updated_at': '2021-06-01T06:16:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '1945cc30-f010-48ee-8395-8f1719cf31be', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'floating_ip_address': '172.27.2.155', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'port_id': '8a7ac687-d801-4596-95ac-7b5a0bb4a7a7', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 570, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8', 'mac_address': 'fa:16:3e:10:8a:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f919b7d-49a2-4b7d-bab0-b076bda23370', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:17:09Z', 'updated_at': '2021-06-01T06:17:09Z', 'revision_number': 0, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ac9595c2-fb73-47ad-a4a7-a8318ad01d8c', 'name': '', 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'mac_address': 'fa:16:3e:a7:87:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'device_owner': 'network:router_interface', 'standard_attr_id': 537, 'fixed_ips': [{'subnet_id': '27e7a9e0-ab4e-478c-aff2-55a26159dc84', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:16:01Z', 'updated_at': '2021-06-01T06:16:08Z', 'revision_number': 5, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'subnets': [{'id': '27e7a9e0-ab4e-478c-aff2-55a26159dc84', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:12.045579 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7eaab361-9cf6-48ee-b27a-577279dab3db req-ba40a9f8-8ccd-46a6-89d5-a30cc344ac5d tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2160144
Jun 01 06:17:12.047345 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1929c552-400d-4e4b-9a0f-2816e45f0b94 None None] The sync data for ids ['4b9daac3-8875-4acd-af69-09a389effcf9'] in dv-cinder-793885-1-iscsi is: [{'id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'name': 'tempest-TestMinimumBasicScenario-2100526911-router', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54'}], 'enable_snat': True}, 'gw_port_id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:15:55Z', 'updated_at': '2021-06-01T06:16:02Z', 'revision_number': 4, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'gw_port': {'id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:16:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:15:56Z', 'updated_at': '2021-06-01T06:16:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '1945cc30-f010-48ee-8395-8f1719cf31be', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'floating_ip_address': '172.27.2.155', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'port_id': '8a7ac687-d801-4596-95ac-7b5a0bb4a7a7', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 570, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8', 'mac_address': 'fa:16:3e:10:8a:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f919b7d-49a2-4b7d-bab0-b076bda23370', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:17:09Z', 'updated_at': '2021-06-01T06:17:09Z', 'revision_number': 0, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ac9595c2-fb73-47ad-a4a7-a8318ad01d8c', 'name': '', 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'mac_address': 'fa:16:3e:a7:87:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'device_owner': 'network:router_interface', 'standard_attr_id': 537, 'fixed_ips': [{'subnet_id': '27e7a9e0-ab4e-478c-aff2-55a26159dc84', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:16:01Z', 'updated_at': '2021-06-01T06:16:08Z', 'revision_number': 5, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'subnets': [{'id': '27e7a9e0-ab4e-478c-aff2-55a26159dc84', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:17:12.052926 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-7212a4c0-a8f0-471c-b953-455f5d18c865 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:12.074309 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d57a9e0b-9f4d-4e88-b6d9-23b4c73d746f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c99f8cf4-6511-4d1d-9a35-5fdc962e6ea4,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:12.079895 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-d57a9e0b-9f4d-4e88-b6d9-23b4c73d746f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:12.090174 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d57a9e0b-9f4d-4e88-b6d9-23b4c73d746f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.091947 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-d57a9e0b-9f4d-4e88-b6d9-23b4c73d746f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.1948016
Jun 01 06:17:12.094396 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 38744) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:12.099900 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-e506d970-4ca7-4d94-a3e7-2c3ee1615938 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Request body: {'security_group_rule': {'security_group_id': '8b6148b9-b790-4563-ad28-9c548198b033', 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:17:12.107821 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e506d970-4ca7-4d94-a3e7-2c3ee1615938 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:17:12.113637 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e506d970-4ca7-4d94-a3e7-2c3ee1615938 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Usage tracker for resource:security_group_rule and tenant:c0ca2b878b874fe4af6e7b9fa8f6cf59 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:17:12.116953 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-e506d970-4ca7-4d94-a3e7-2c3ee1615938 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:17:12.124310 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-e506d970-4ca7-4d94-a3e7-2c3ee1615938 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:17:12.133500 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-bb929459-b8b5-4b85-a1c3-db538dfa46de req-4adfe048-cf2b-4fb6-8b1d-ae83a3c4b24a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.142841 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e506d970-4ca7-4d94-a3e7-2c3ee1615938 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.143443 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:12.186655 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee569be8-49f6-41ef-ad2e-c7920058a4ef req-2c8a8140-5eb6-43e9-8f9f-5da9f10ddb45 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:12.188220 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ee569be8-49f6-41ef-ad2e-c7920058a4ef req-2c8a8140-5eb6-43e9-8f9f-5da9f10ddb45 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 945 time: 0.4482076
Jun 01 06:17:12.203678 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b4eedec-8d7f-448d-b23c-2edb3923b2b1 req-b09ceea7-140e-4e87-b9b8-442460a37eb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:12.205126 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5b4eedec-8d7f-448d-b23c-2edb3923b2b1 req-b09ceea7-140e-4e87-b9b8-442460a37eb1 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=27e7a9e0-ab4e-478c-aff2-55a26159dc84 HTTP/1.1" status: 200  len: 854 time: 0.1547482
Jun 01 06:17:12.215645 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e506d970-4ca7-4d94-a3e7-2c3ee1615938 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.222356 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e506d970-4ca7-4d94-a3e7-2c3ee1615938 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.225044 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:12.233020 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4adfe048-cf2b-4fb6-8b1d-ae83a3c4b24a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Pushing event deleted for resources: {'Port': ['ID=7d7451f5-3439-4d43-8bf7-ac121c8931c4,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:12.235680 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-4adfe048-cf2b-4fb6-8b1d-ae83a3c4b24a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:12.245375 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e506d970-4ca7-4d94-a3e7-2c3ee1615938 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9b819100-dcd3-41d7-bde6-284379a890e0,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:12.249617 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e506d970-4ca7-4d94-a3e7-2c3ee1615938 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:12.270479 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e506d970-4ca7-4d94-a3e7-2c3ee1615938 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.271908 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-e506d970-4ca7-4d94-a3e7-2c3ee1615938 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.1764588
Jun 01 06:17:12.274581 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 38748) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:12.281158 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-3f943204-7099-4248-9d99-6feb90487966 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Request body: {'security_group_rule': {'security_group_id': '8b6148b9-b790-4563-ad28-9c548198b033', 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:17:12.287320 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-3f943204-7099-4248-9d99-6feb90487966 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:17:12.291467 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-3f943204-7099-4248-9d99-6feb90487966 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Usage tracker for resource:security_group_rule and tenant:c0ca2b878b874fe4af6e7b9fa8f6cf59 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:17:12.294885 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-3f943204-7099-4248-9d99-6feb90487966 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:17:12.302121 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-3f943204-7099-4248-9d99-6feb90487966 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:17:12.319152 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3f943204-7099-4248-9d99-6feb90487966 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.354679 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4580fcc4-0bea-4af2-a38a-e3bf21ebcf2d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.377546 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6e472183-712c-4fa4-b4a7-4f76e944bc39 None None] New status for floating IP 1945cc30-f010-48ee-8395-8f1719cf31be: ACTIVE {{(pid=92232) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 06:17:12.401800 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3f943204-7099-4248-9d99-6feb90487966 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.406484 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3f943204-7099-4248-9d99-6feb90487966 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.408713 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-9e801ffe-5f57-453a-a66a-fcbabf0da4fe tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:12.424034 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ee569be8-49f6-41ef-ad2e-c7920058a4ef req-cc1dad77-2d7a-4900-a327-777f47546f47 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2227671
Jun 01 06:17:12.434442 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f943204-7099-4248-9d99-6feb90487966 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a8ade7df-5649-4725-bcbe-162cdc47dc96,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:12.443593 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-3f943204-7099-4248-9d99-6feb90487966 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:12.455163 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3f943204-7099-4248-9d99-6feb90487966 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.456984 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-3f943204-7099-4248-9d99-6feb90487966 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.1811490
Jun 01 06:17:12.459732 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 38752) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:12.466629 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-9979151c-79f3-46dd-b44e-dffc8b13c1a3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Request body: {'security_group_rule': {'security_group_id': '8b6148b9-b790-4563-ad28-9c548198b033', 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:17:12.473800 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-9979151c-79f3-46dd-b44e-dffc8b13c1a3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:17:12.478088 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-9979151c-79f3-46dd-b44e-dffc8b13c1a3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Usage tracker for resource:security_group_rule and tenant:c0ca2b878b874fe4af6e7b9fa8f6cf59 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:17:12.483227 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-9979151c-79f3-46dd-b44e-dffc8b13c1a3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:17:12.489604 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-9979151c-79f3-46dd-b44e-dffc8b13c1a3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:17:12.509794 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9979151c-79f3-46dd-b44e-dffc8b13c1a3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.518443 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b4eedec-8d7f-448d-b23c-2edb3923b2b1 req-65efe7ff-4b2e-45e3-898b-2d423542885c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:12.519972 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5b4eedec-8d7f-448d-b23c-2edb3923b2b1 req-65efe7ff-4b2e-45e3-898b-2d423542885c service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=d36c4486-6b2d-4439-996b-f13c04a98cb8&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3029866
Jun 01 06:17:12.600450 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9979151c-79f3-46dd-b44e-dffc8b13c1a3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.606653 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9979151c-79f3-46dd-b44e-dffc8b13c1a3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.611663 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-6c57ca6b-1158-402e-89bf-a0d1445a7f66 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:12.639445 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.l3_agent_scheduler [req-bb929459-b8b5-4b85-a1c3-db538dfa46de req-4adfe048-cf2b-4fb6-8b1d-ae83a3c4b24a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Router 00ab7a71-e7f7-4524-99c9-7562f23905d1 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92229) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:17:12.653552 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9979151c-79f3-46dd-b44e-dffc8b13c1a3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=15aa76db-efe8-488d-8c70-7330cd7a270c,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:12.663977 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-9979151c-79f3-46dd-b44e-dffc8b13c1a3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:12.671002 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9979151c-79f3-46dd-b44e-dffc8b13c1a3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.674867 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-9979151c-79f3-46dd-b44e-dffc8b13c1a3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.2113578
Jun 01 06:17:12.675144 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 38758) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:12.683088 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-4eddf14b-4b48-4f26-88d0-228ab2c5396e tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Request body: {'security_group_rule': {'security_group_id': '8b6148b9-b790-4563-ad28-9c548198b033', 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:17:12.690929 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-4eddf14b-4b48-4f26-88d0-228ab2c5396e tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:17:12.695320 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-4eddf14b-4b48-4f26-88d0-228ab2c5396e tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Usage tracker for resource:security_group_rule and tenant:c0ca2b878b874fe4af6e7b9fa8f6cf59 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:17:12.698870 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-4eddf14b-4b48-4f26-88d0-228ab2c5396e tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:17:12.704828 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-4eddf14b-4b48-4f26-88d0-228ab2c5396e tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:17:12.721390 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.db.securitygroups_db [None req-4eddf14b-4b48-4f26-88d0-228ab2c5396e tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Project c0ca2b878b874fe4af6e7b9fa8f6cf59 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 06:17:12.730580 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4eddf14b-4b48-4f26-88d0-228ab2c5396e tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.799668 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5b4eedec-8d7f-448d-b23c-2edb3923b2b1 req-62934eb1-ff68-4405-8967-437866d57926 service neutron] 10.222.0.48 "GET /v2.0/networks/d36c4486-6b2d-4439-996b-f13c04a98cb8?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2721851
Jun 01 06:17:12.816546 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4eddf14b-4b48-4f26-88d0-228ab2c5396e tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.821602 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4eddf14b-4b48-4f26-88d0-228ab2c5396e tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.824488 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-3ee364b0-6dec-4dce-9e67-8005e34c7065 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:12.847537 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eddf14b-4b48-4f26-88d0-228ab2c5396e tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d7bfafd5-7759-423d-9126-54d6453eb83a,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:12.852985 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-4eddf14b-4b48-4f26-88d0-228ab2c5396e tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:12.858334 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4eddf14b-4b48-4f26-88d0-228ab2c5396e tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.859900 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-4eddf14b-4b48-4f26-88d0-228ab2c5396e tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.1835434
Jun 01 06:17:12.862552 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 38762) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:12.867564 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-32ce44bb-d10d-46e3-a453-aa76a1f4bc89 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Request body: {'security_group_rule': {'security_group_id': '8b6148b9-b790-4563-ad28-9c548198b033', 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:17:12.874539 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-32ce44bb-d10d-46e3-a453-aa76a1f4bc89 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:17:12.878320 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-32ce44bb-d10d-46e3-a453-aa76a1f4bc89 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Usage tracker for resource:security_group_rule and tenant:c0ca2b878b874fe4af6e7b9fa8f6cf59 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:17:12.881171 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-32ce44bb-d10d-46e3-a453-aa76a1f4bc89 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:17:12.887612 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-32ce44bb-d10d-46e3-a453-aa76a1f4bc89 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:17:12.897680 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.db.securitygroups_db [None req-32ce44bb-d10d-46e3-a453-aa76a1f4bc89 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Project c0ca2b878b874fe4af6e7b9fa8f6cf59 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 06:17:12.905105 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-32ce44bb-d10d-46e3-a453-aa76a1f4bc89 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.971367 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-32ce44bb-d10d-46e3-a453-aa76a1f4bc89 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.975285 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-32ce44bb-d10d-46e3-a453-aa76a1f4bc89 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724364'] for security_group_rule, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:12.976843 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-bb929459-b8b5-4b85-a1c3-db538dfa46de req-4adfe048-cf2b-4fb6-8b1d-ae83a3c4b24a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92229) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:17:12.982182 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e506d970-4ca7-4d94-a3e7-2c3ee1615938 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:12.989459 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bc05e43-d6be-462f-a973-115e6948424e None None] Sync routers for ids ['00ab7a71-e7f7-4524-99c9-7562f23905d1'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:17:12.999595 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bc05e43-d6be-462f-a973-115e6948424e None None] Routers {'00ab7a71-e7f7-4524-99c9-7562f23905d1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:17:13.000237 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-7bc05e43-d6be-462f-a973-115e6948424e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b330c8b0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:17:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['00ab7a71-e7f7-4524-99c9-7562f23905d1'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:13.002613 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32ce44bb-d10d-46e3-a453-aa76a1f4bc89 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0675b33c-2df0-48b1-b615-1c96e93cc756,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:13.005192 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-32ce44bb-d10d-46e3-a453-aa76a1f4bc89 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:13.015124 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-32ce44bb-d10d-46e3-a453-aa76a1f4bc89 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:13.019406 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-32ce44bb-d10d-46e3-a453-aa76a1f4bc89 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.1531513
Jun 01 06:17:13.192279 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-7bc05e43-d6be-462f-a973-115e6948424e None None] Set router 00ab7a71-e7f7-4524-99c9-7562f23905d1 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:17:13.258899 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-bb929459-b8b5-4b85-a1c3-db538dfa46de req-4adfe048-cf2b-4fb6-8b1d-ae83a3c4b24a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] No DVR routers for this DVR port 7d7451f5-3439-4d43-8bf7-ac121c8931c4 on host hv-cinder-79388 {{(pid=92229) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:17:13.267592 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-bb929459-b8b5-4b85-a1c3-db538dfa46de req-4adfe048-cf2b-4fb6-8b1d-ae83a3c4b24a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:13.277080 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '09215815-8dd9-46e4-879a-7c3b58e35a54', 'name': 'network-vif-deleted', 'tag': '7d7451f5-3439-4d43-8bf7-ac121c8931c4'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:17:13.280150 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c16e097b-040d-4806-a0b9-5a89016e7b46" -d '{"events": [{"server_uuid": "09215815-8dd9-46e4-879a-7c3b58e35a54", "name": "network-vif-deleted", "tag": "7d7451f5-3439-4d43-8bf7-ac121c8931c4"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:17:13.283986 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5b4eedec-8d7f-448d-b23c-2edb3923b2b1 req-634bf3f5-6c76-40d3-9593-bd945891fcb2 service neutron] 10.222.0.48 "GET /v2.0/networks/d36c4486-6b2d-4439-996b-f13c04a98cb8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4346559
Jun 01 06:17:13.296915 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7ca39aef-7d30-4a10-8c0d-17f847a27643 req-bc5d9e98-299d-4e7c-a423-64bfe5f42fae tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=09215815-8dd9-46e4-879a-7c3b58e35a54 HTTP/1.1" status: 200  len: 210 time: 0.0878754
Jun 01 06:17:13.307709 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-13321ff1-b7ed-4725-abc0-0c31633284b9 req-d47c743c-089b-42aa-a43b-057e095c287a tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Synchronizing usage tracker for tenant:c0ca2b878b874fe4af6e7b9fa8f6cf59 on resource:security_group {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:17:13.318489 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bb929459-b8b5-4b85-a1c3-db538dfa46de req-4adfe048-cf2b-4fb6-8b1d-ae83a3c4b24a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.48 "DELETE /v2.0/ports/7d7451f5-3439-4d43-8bf7-ac121c8931c4 HTTP/1.1" status: 204  len: 173 time: 2.6927314
Jun 01 06:17:13.331592 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-13321ff1-b7ed-4725-abc0-0c31633284b9 req-d47c743c-089b-42aa-a43b-057e095c287a tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Unset dirty status for tenant:c0ca2b878b874fe4af6e7b9fa8f6cf59 on resource:security_group {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:17:13.332970 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-13321ff1-b7ed-4725-abc0-0c31633284b9 req-d47c743c-089b-42aa-a43b-057e095c287a tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1799299822&fields=id&tenant_id=c0ca2b878b874fe4af6e7b9fa8f6cf59 HTTP/1.1" status: 200  len: 267 time: 0.1863782
Jun 01 06:17:13.339001 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:13.438095 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13321ff1-b7ed-4725-abc0-0c31633284b9 req-bb011f75-595b-40c4-9fa7-06551c217571 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:13.444423 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-13321ff1-b7ed-4725-abc0-0c31633284b9 req-bb011f75-595b-40c4-9fa7-06551c217571 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 945 time: 0.0969713
Jun 01 06:17:13.453063 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-13321ff1-b7ed-4725-abc0-0c31633284b9 req-77d25a56-a19a-422a-902c-f84de06da9b3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Request body: {'port': {'security_groups': ['5985373d-9e4a-40aa-ae6a-494024c07169', '8b6148b9-b790-4563-ad28-9c548198b033']}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:17:13.487992 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:17:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4f9f0014-8334-4fb8-ba72-f1ef40f4e72c x-openstack-request-id: req-4f9f0014-8334-4fb8-ba72-f1ef40f4e72c {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:17:13.488399 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "09215815-8dd9-46e4-879a-7c3b58e35a54", "name": "network-vif-deleted", "tag": "7d7451f5-3439-4d43-8bf7-ac121c8931c4", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:17:13.488591 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-4f9f0014-8334-4fb8-ba72-f1ef40f4e72c {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:17:13.488992 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '09215815-8dd9-46e4-879a-7c3b58e35a54', 'name': 'network-vif-deleted', 'tag': '7d7451f5-3439-4d43-8bf7-ac121c8931c4', 'status': 'completed', 'code': 200}
Jun 01 06:17:13.544244 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-7bc05e43-d6be-462f-a973-115e6948424e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b330c8b0>, [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': 'cd6dda6e-46d3-4412-9652-c686f5fad712', 'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'mac_address': 'fa:16:3e:aa:f2:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:24Z', 'updated_at': '2021-06-01T06:13:41Z', 'revision_number': 5, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'subnets': [{'id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:13.548338 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bc05e43-d6be-462f-a973-115e6948424e None None] Checking router: 00ab7a71-e7f7-4524-99c9-7562f23905d1 for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:17:13.560509 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bc05e43-d6be-462f-a973-115e6948424e None None] Routers {'00ab7a71-e7f7-4524-99c9-7562f23905d1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:17:13.561208 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-7bc05e43-d6be-462f-a973-115e6948424e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b330c8b0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:17:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['00ab7a71-e7f7-4524-99c9-7562f23905d1'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:13.641751 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-13321ff1-b7ed-4725-abc0-0c31633284b9 req-77d25a56-a19a-422a-902c-f84de06da9b3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:13.739441 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51bf62c2-1a10-45f2-91e8-a93776613e10 req-bb2a8f2f-a1ec-4a74-a6b3-3ffac99e6363 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:13.740938 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-51bf62c2-1a10-45f2-91e8-a93776613e10 req-bb2a8f2f-a1ec-4a74-a6b3-3ffac99e6363 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 945 time: 0.1902401
Jun 01 06:17:13.788800 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-7bc05e43-d6be-462f-a973-115e6948424e None None] Set router 00ab7a71-e7f7-4524-99c9-7562f23905d1 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:17:13.830169 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-51bf62c2-1a10-45f2-91e8-a93776613e10 req-22a08910-d5b3-4c27-8d5a-fc03a5583f17 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0759609
Jun 01 06:17:13.980262 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-13321ff1-b7ed-4725-abc0-0c31633284b9 req-77d25a56-a19a-422a-902c-f84de06da9b3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] For port 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=8a7ac687-d801-4596-95ac-7b5a0bb4a7a7,segment=NetworkSegment(c40d74a4-eecc-4c63-8fd5-38ee39e77ccd),segment_id=c40d74a4-eecc-4c63-8fd5-38ee39e77ccd)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:17:14.004287 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-13321ff1-b7ed-4725-abc0-0c31633284b9 req-77d25a56-a19a-422a-902c-f84de06da9b3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:14.008845 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-13321ff1-b7ed-4725-abc0-0c31633284b9 req-77d25a56-a19a-422a-902c-f84de06da9b3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2077419'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:14.014880 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-67845aaf-87b7-46a4-85a9-9b5e39d29a4c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:14.030519 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['8a7ac687-d801-4596-95ac-7b5a0bb4a7a7'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:17:14.084927 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13321ff1-b7ed-4725-abc0-0c31633284b9 req-77d25a56-a19a-422a-902c-f84de06da9b3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:14.085567 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-13321ff1-b7ed-4725-abc0-0c31633284b9 req-77d25a56-a19a-422a-902c-f84de06da9b3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:14.087045 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-13321ff1-b7ed-4725-abc0-0c31633284b9 req-77d25a56-a19a-422a-902c-f84de06da9b3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "PUT /v2.0/ports/8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 HTTP/1.1" status: 200  len: 981 time: 0.6397443
Jun 01 06:17:14.122149 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77d25a56-a19a-422a-902c-f84de06da9b3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Pushing event updated for resources: {'Port': ['ID=8a7ac687-d801-4596-95ac-7b5a0bb4a7a7,revision_number=6']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:14.125211 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-77d25a56-a19a-422a-902c-f84de06da9b3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:14.198798 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['8a7ac687-d801-4596-95ac-7b5a0bb4a7a7'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:17:14.296341 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90f1e944-9b21-4fe0-a0bc-2dfd1913c48f req-7be91064-d13d-455e-8d05-798c5ba73643 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:14.300308 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-90f1e944-9b21-4fe0-a0bc-2dfd1913c48f req-7be91064-d13d-455e-8d05-798c5ba73643 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.0918126
Jun 01 06:17:14.364035 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-90f1e944-9b21-4fe0-a0bc-2dfd1913c48f req-4c76784e-07ed-4021-86af-5bf9221c5783 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0599024
Jun 01 06:17:14.368088 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-7bc05e43-d6be-462f-a973-115e6948424e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b330c8b0>, [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': 'cd6dda6e-46d3-4412-9652-c686f5fad712', 'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'mac_address': 'fa:16:3e:aa:f2:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:24Z', 'updated_at': '2021-06-01T06:13:41Z', 'revision_number': 5, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'subnets': [{'id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:14.376899 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bc05e43-d6be-462f-a973-115e6948424e None None] The sync data for ids ['00ab7a71-e7f7-4524-99c9-7562f23905d1'] in dv-cinder-793885-1-iscsi is: [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': 'cd6dda6e-46d3-4412-9652-c686f5fad712', 'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'mac_address': 'fa:16:3e:aa:f2:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:24Z', 'updated_at': '2021-06-01T06:13:41Z', 'revision_number': 5, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'subnets': [{'id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:17:14.478560 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-625b288a-1996-42b7-a5a1-ea468fd9c460 None None] Provisioning complete for port 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:17:14.478956 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-625b288a-1996-42b7-a5a1-ea468fd9c460 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:14.664798 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b744faf4-1e53-4935-8642-0433b746481d None None] New status for floating IP 4c6a9e9d-ea2e-4346-a164-98d7263ff8aa: DOWN {{(pid=92232) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 06:17:14.696328 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 7d7451f5-3439-4d43-8bf7-ac121c8931c4 no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:17:14.754133 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-0fb776fb-516f-4e6a-a12b-01b56c5dafcf tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1032536289&fields=id&tenant_id=e8bcff3fed924886a68a8562a9f4f8f3 HTTP/1.1" status: 200  len: 267 time: 0.0469322
Jun 01 06:17:14.774634 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] No Port match for: 7d7451f5-3439-4d43-8bf7-ac121c8931c4 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:17:14.774973 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 7d7451f5-3439-4d43-8bf7-ac121c8931c4 not bound to the agent host hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:17:14.936940 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-e15e5b44-911e-468a-81fa-d09509e4c8cd tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:14.939175 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-e15e5b44-911e-468a-81fa-d09509e4c8cd tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/networks?id=028fef0a-f05a-48d5-ba5c-b539846209ba HTTP/1.1" status: 200  len: 811 time: 0.1761820
Jun 01 06:17:14.956506 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-36062fe4-f57e-4871-9ca2-786f11264fef tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/quotas/e8bcff3fed924886a68a8562a9f4f8f3 HTTP/1.1" status: 200  len: 375 time: 0.0102780
Jun 01 06:17:15.109591 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-0a475e57-19f2-4649-b8cd-f4f9ecd4dc44 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Synchronizing usage tracker for tenant:e8bcff3fed924886a68a8562a9f4f8f3 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:17:15.126119 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cc5f826-ace6-413c-a650-7a7f732522c5 req-740bd49b-fcbc-4134-8f27-638f3b46591f tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:15.127513 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5cc5f826-ace6-413c-a650-7a7f732522c5 req-740bd49b-fcbc-4134-8f27-638f3b46591f tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 945 time: 0.1265481
Jun 01 06:17:15.152493 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-0a475e57-19f2-4649-b8cd-f4f9ecd4dc44 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Unset dirty status for tenant:e8bcff3fed924886a68a8562a9f4f8f3 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:17:15.153755 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-0a475e57-19f2-4649-b8cd-f4f9ecd4dc44 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=e8bcff3fed924886a68a8562a9f4f8f3&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1913235
Jun 01 06:17:15.194099 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5cc5f826-ace6-413c-a650-7a7f732522c5 req-9885a0f9-952e-419b-b950-670511bf0510 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0604198
Jun 01 06:17:15.303955 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-96bce03b-5b00-4fc8-8a24-8d3a25602167 service neutron] 10.222.0.25 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1314094
Jun 01 06:17:15.371885 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:15.436647 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-180990c8-67a7-483c-b80d-b1a142c30c4a service neutron] 10.222.0.25 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1261899
Jun 01 06:17:15.490358 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5f919b7d-49a2-4b7d-bab0-b076bda23370', 'tag': '8a7ac687-d801-4596-95ac-7b5a0bb4a7a7'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:17:15.492858 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-590b83e2-fc08-4c52-863b-ec1545a0b8f2" -d '{"events": [{"name": "network-changed", "server_uuid": "5f919b7d-49a2-4b7d-bab0-b076bda23370", "tag": "8a7ac687-d801-4596-95ac-7b5a0bb4a7a7"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:17:15.536550 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:17:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a53d4602-cfd6-4174-9c0b-3eaf09500bb6 x-openstack-request-id: req-a53d4602-cfd6-4174-9c0b-3eaf09500bb6 {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:17:15.537029 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5f919b7d-49a2-4b7d-bab0-b076bda23370", "tag": "8a7ac687-d801-4596-95ac-7b5a0bb4a7a7", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:17:15.537238 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-a53d4602-cfd6-4174-9c0b-3eaf09500bb6 {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:17:15.537670 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5f919b7d-49a2-4b7d-bab0-b076bda23370', 'tag': '8a7ac687-d801-4596-95ac-7b5a0bb4a7a7', 'status': 'completed', 'code': 200}
Jun 01 06:17:15.632754 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-590b83e2-fc08-4c52-863b-ec1545a0b8f2 req-96adabea-3847-4a2d-9103-4d5732bdf93a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:15.634271 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-590b83e2-fc08-4c52-863b-ec1545a0b8f2 req-96adabea-3847-4a2d-9103-4d5732bdf93a service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=c0ca2b878b874fe4af6e7b9fa8f6cf59&device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 1137 time: 0.0709836
Jun 01 06:17:15.884426 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-321b80ee-4fbb-4e12-acac-69215bfbee45 req-7253def0-a344-4d7d-836a-e06709f248e3 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 210 time: 0.0574713
Jun 01 06:17:15.927033 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-590b83e2-fc08-4c52-863b-ec1545a0b8f2 req-a19e6175-da90-4c5a-9b65-8759df4128bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:15.928544 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-590b83e2-fc08-4c52-863b-ec1545a0b8f2 req-a19e6175-da90-4c5a-9b65-8759df4128bb service neutron] 10.222.0.48 "GET /v2.0/networks?id=d36c4486-6b2d-4439-996b-f13c04a98cb8 HTTP/1.1" status: 200  len: 916 time: 0.2827041
Jun 01 06:17:15.975321 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:16.043274 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-590b83e2-fc08-4c52-863b-ec1545a0b8f2 req-74b3ea3a-c65f-43c1-97ca-67a39dea0a8e service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 HTTP/1.1" status: 200  len: 1001 time: 0.1070898
Jun 01 06:17:16.109549 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-590b83e2-fc08-4c52-863b-ec1545a0b8f2 req-c19be887-6c0d-4b9b-82ea-e77ad61d3251 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:16.111100 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-590b83e2-fc08-4c52-863b-ec1545a0b8f2 req-c19be887-6c0d-4b9b-82ea-e77ad61d3251 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=27e7a9e0-ab4e-478c-aff2-55a26159dc84 HTTP/1.1" status: 200  len: 854 time: 0.0604918
Jun 01 06:17:16.195014 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-590b83e2-fc08-4c52-863b-ec1545a0b8f2 req-a937318b-bfb9-482a-96ef-e2bd96158641 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:16.196559 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-590b83e2-fc08-4c52-863b-ec1545a0b8f2 req-a937318b-bfb9-482a-96ef-e2bd96158641 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=d36c4486-6b2d-4439-996b-f13c04a98cb8&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0774872
Jun 01 06:17:16.390712 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-590b83e2-fc08-4c52-863b-ec1545a0b8f2 req-9e002fd7-c2b9-48dd-b735-d5622b60ef35 service neutron] 10.222.0.48 "GET /v2.0/networks/d36c4486-6b2d-4439-996b-f13c04a98cb8?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1866961
Jun 01 06:17:16.520806 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a89b6f1b-8b9b-41d6-a354-9be8449316c4 req-fe4dcb1a-a713-4131-b42f-a2e308d7e7d1 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:16.522183 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a89b6f1b-8b9b-41d6-a354-9be8449316c4 req-fe4dcb1a-a713-4131-b42f-a2e308d7e7d1 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 945 time: 0.2076225
Jun 01 06:17:16.587700 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-590b83e2-fc08-4c52-863b-ec1545a0b8f2 req-74c159a2-fc15-4611-b6fb-24bc2a7c5fda service neutron] 10.222.0.48 "GET /v2.0/networks/d36c4486-6b2d-4439-996b-f13c04a98cb8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1876452
Jun 01 06:17:16.599143 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a89b6f1b-8b9b-41d6-a354-9be8449316c4 req-44642064-6d0f-46b7-8933-da127d281340 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0630009
Jun 01 06:17:17.040295 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-21c7b5d9-c596-45ec-a9d9-6aadee379eef tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:17.042006 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-21c7b5d9-c596-45ec-a9d9-6aadee379eef tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.48 "GET /v2.0/networks?id=028fef0a-f05a-48d5-ba5c-b539846209ba HTTP/1.1" status: 200  len: 811 time: 0.1626816
Jun 01 06:17:17.105032 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5db7db41-b871-413f-8fc9-95c86ac3f674 req-a5005753-9ae6-46b7-8151-55fe12c484b2 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 210 time: 0.0725894
Jun 01 06:17:17.138419 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-593df896-1469-490e-9dd4-fd9731ea2323 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.48 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=e8bcff3fed924886a68a8562a9f4f8f3 HTTP/1.1" status: 200  len: 380 time: 0.0645771
Jun 01 06:17:17.150198 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7c212c4a-89a3-4e39-aa8a-1a0cd1515087 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Request body: {'port': {'device_id': 'c3152e52-efff-440c-a60c-0c4b931f7132', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'admin_state_up': True, 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'security_groups': ['837b69a3-6811-4cdc-8ade-9ad4352f4196']}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:17:17.297385 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7c212c4a-89a3-4e39-aa8a-1a0cd1515087 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:17:17.307230 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7c212c4a-89a3-4e39-aa8a-1a0cd1515087 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:17:17.317239 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7c212c4a-89a3-4e39-aa8a-1a0cd1515087 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Made reservation on behalf of e8bcff3fed924886a68a8562a9f4f8f3 for: {'port': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:17:17.321210 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7c212c4a-89a3-4e39-aa8a-1a0cd1515087 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:17.491648 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7c212c4a-89a3-4e39-aa8a-1a0cd1515087 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Allocated IP 172.20.0.7 (028fef0a-f05a-48d5-ba5c-b539846209ba/cdffe000-7f35-495d-a741-b4c48a060887/5ba208bf-2519-4a15-b4f5-8246cedadc63) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:17:17.737669 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7c212c4a-89a3-4e39-aa8a-1a0cd1515087 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:17.758993 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7c212c4a-89a3-4e39-aa8a-1a0cd1515087 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Transition to ACTIVE for port object 5ba208bf-2519-4a15-b4f5-8246cedadc63 will not be triggered until provisioned by entity DHCP. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:17:17.844971 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7c212c4a-89a3-4e39-aa8a-1a0cd1515087 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:17.851391 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-1b1a2fb2-2ed1-4415-89d0-828b99eb38b5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:18.002572 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18352704-f32f-4f3f-a430-eaba1d515166 req-c65af77d-242b-4617-af22-856665f9d5c1 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:18.003934 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-18352704-f32f-4f3f-a430-eaba1d515166 req-c65af77d-242b-4617-af22-856665f9d5c1 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 945 time: 0.2470629
Jun 01 06:17:18.039254 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7c212c4a-89a3-4e39-aa8a-1a0cd1515087 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Network 028fef0a-f05a-48d5-ba5c-b539846209ba is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:17:18.046272 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7c212c4a-89a3-4e39-aa8a-1a0cd1515087 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:17:18.054010 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7c212c4a-89a3-4e39-aa8a-1a0cd1515087 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:17:18.082048 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c212c4a-89a3-4e39-aa8a-1a0cd1515087 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Pushing event updated for resources: {'Port': ['ID=5ba208bf-2519-4a15-b4f5-8246cedadc63,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:18.094256 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-7c212c4a-89a3-4e39-aa8a-1a0cd1515087 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.243s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:18.123087 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-18352704-f32f-4f3f-a430-eaba1d515166 req-c7f34636-b56c-4241-b7b6-613594f88584 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1094902
Jun 01 06:17:18.140969 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7c212c4a-89a3-4e39-aa8a-1a0cd1515087 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:18.141545 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7c212c4a-89a3-4e39-aa8a-1a0cd1515087 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:18.170936 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7c212c4a-89a3-4e39-aa8a-1a0cd1515087 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.0245717
Jun 01 06:17:18.192272 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Request body: {'port': {'device_id': 'c3152e52-efff-440c-a60c-0c4b931f7132', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79388'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:17:18.285881 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-7195771c-f599-4787-8095-7ec5ccf05596 None None] Provisioning for port 5ba208bf-2519-4a15-b4f5-8246cedadc63 completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:17:18.290716 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-7195771c-f599-4787-8095-7ec5ccf05596 None None] Provisioning complete for port 5ba208bf-2519-4a15-b4f5-8246cedadc63 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:17:18.291147 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-7195771c-f599-4787-8095-7ec5ccf05596 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:18.358120 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-7195771c-f599-4787-8095-7ec5ccf05596 None None] Port 5ba208bf-2519-4a15-b4f5-8246cedadc63 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:17:18.404738 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:18.432935 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b346e9f-117b-4ad0-be1e-748cda2ec520 req-2e10d574-2046-466b-8917-f2bd711f455b tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:18.433639 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-9b346e9f-117b-4ad0-be1e-748cda2ec520 req-2e10d574-2046-466b-8917-f2bd711f455b tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Synchronizing usage tracker for tenant:e8bcff3fed924886a68a8562a9f4f8f3 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:17:18.490875 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-9b346e9f-117b-4ad0-be1e-748cda2ec520 req-2e10d574-2046-466b-8917-f2bd711f455b tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Unset dirty status for tenant:e8bcff3fed924886a68a8562a9f4f8f3 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:17:18.492058 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9b346e9f-117b-4ad0-be1e-748cda2ec520 req-2e10d574-2046-466b-8917-f2bd711f455b tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 931 time: 0.2412462
Jun 01 06:17:18.605611 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9b346e9f-117b-4ad0-be1e-748cda2ec520 req-798d092a-ea6d-4b7d-8c57-980244abb2a4 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1067009
Jun 01 06:17:18.812146 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5ba208bf-2519-4a15-b4f5-8246cedadc63 {{(pid=92229) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:17:18.819354 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:18.835177 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Transition to ACTIVE for port object 5ba208bf-2519-4a15-b4f5-8246cedadc63 will not be triggered until provisioned by entity L2. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:17:18.839227 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2077419'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:18.844220 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-d792ce61-211d-49c8-a551-9165be8bb274 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:19.013576 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Pushing event updated for resources: {'Port': ['ID=5ba208bf-2519-4a15-b4f5-8246cedadc63,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:19.022654 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:19.105776 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Attempting to bind port 5ba208bf-2519-4a15-b4f5-8246cedadc63 on host hv-cinder-79388 for vnic_type normal with profile  {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:17:19.106439 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Attempting to bind port 5ba208bf-2519-4a15-b4f5-8246cedadc63 by drivers openvswitch,hyperv on host hv-cinder-79388 at level 0 using segments [{'id': 'e9a368be-e119-4f56-bdcc-b9d10543e0d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 209, 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba'}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:17:19.106439 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Attempting to bind port 5ba208bf-2519-4a15-b4f5-8246cedadc63 on network 028fef0a-f05a-48d5-ba5c-b539846209ba {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:17:19.111740 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Port 5ba208bf-2519-4a15-b4f5-8246cedadc63 on network 028fef0a-f05a-48d5-ba5c-b539846209ba not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79388 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 06:17:19.112117 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Attempting to bind port 5ba208bf-2519-4a15-b4f5-8246cedadc63 on network 028fef0a-f05a-48d5-ba5c-b539846209ba {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:17:19.117351 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Checking agent: {'id': '56148394-2131-4d06-bcfa-c032301591b8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79388', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'started_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 17, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:17:19.117685 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Checking segment: {'id': 'e9a368be-e119-4f56-bdcc-b9d10543e0d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 209, 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:17:19.118180 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Bound using segment: {'id': 'e9a368be-e119-4f56-bdcc-b9d10543e0d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 209, 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba'} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:17:19.118606 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Bound port: 5ba208bf-2519-4a15-b4f5-8246cedadc63, host: hv-cinder-79388, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e9a368be-e119-4f56-bdcc-b9d10543e0d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 209, 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba'}}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:17:19.118895 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:19.216580 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] For port 5ba208bf-2519-4a15-b4f5-8246cedadc63, host hv-cinder-79388, cleared binding levels {{(pid=92229) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:17:19.220088 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] For port 5ba208bf-2519-4a15-b4f5-8246cedadc63, host hv-cinder-79388, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=5ba208bf-2519-4a15-b4f5-8246cedadc63,segment=NetworkSegment(e9a368be-e119-4f56-bdcc-b9d10543e0d8),segment_id=e9a368be-e119-4f56-bdcc-b9d10543e0d8)] {{(pid=92229) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:17:19.225243 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2077419'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:19.230232 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-5a4e9b4e-4f10-475b-a676-179e3e0685fd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:19.355501 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:19.356139 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:19.357749 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] 10.222.0.48 "PUT /v2.0/ports/5ba208bf-2519-4a15-b4f5-8246cedadc63 HTTP/1.1" status: 200  len: 1093 time: 1.1741216
Jun 01 06:17:19.360885 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c3152e52-efff-440c-a60c-0c4b931f7132', 'tag': '5ba208bf-2519-4a15-b4f5-8246cedadc63'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:17:19.363190 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7725b90c-f717-4859-bbff-2783c89302b1" -d '{"events": [{"name": "network-changed", "server_uuid": "c3152e52-efff-440c-a60c-0c4b931f7132", "tag": "5ba208bf-2519-4a15-b4f5-8246cedadc63"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:17:19.392027 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Pushing event updated for resources: {'Port': ['ID=5ba208bf-2519-4a15-b4f5-8246cedadc63,revision_number=3']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:19.396414 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:19.458503 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:17:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b22adfc5-f146-4cbc-b2f1-65699954a6f2 x-openstack-request-id: req-b22adfc5-f146-4cbc-b2f1-65699954a6f2 {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:17:19.458822 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c3152e52-efff-440c-a60c-0c4b931f7132", "tag": "5ba208bf-2519-4a15-b4f5-8246cedadc63", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:17:19.459106 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-b22adfc5-f146-4cbc-b2f1-65699954a6f2 {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:17:19.459529 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c3152e52-efff-440c-a60c-0c4b931f7132', 'tag': '5ba208bf-2519-4a15-b4f5-8246cedadc63', 'status': 'completed', 'code': 200}
Jun 01 06:17:19.480578 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07aaaa45-8ac1-44ca-aacd-c49c42bf29f4 req-020dbb53-7fba-430a-b94b-3a1b89e892a7 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:19.482106 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-07aaaa45-8ac1-44ca-aacd-c49c42bf29f4 req-020dbb53-7fba-430a-b94b-3a1b89e892a7 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 945 time: 0.2130640
Jun 01 06:17:19.548118 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-07aaaa45-8ac1-44ca-aacd-c49c42bf29f4 req-7852aa9a-c24b-43fb-bfc3-4ea2d04a8b98 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0525718
Jun 01 06:17:19.553192 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-4b6b7ce2-ffd9-4769-8eed-128041a5c942 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:19.554731 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-4b6b7ce2-ffd9-4769-8eed-128041a5c942 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=e8bcff3fed924886a68a8562a9f4f8f3&device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 1096 time: 0.1351469
Jun 01 06:17:19.634029 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-231819df-ce58-4876-94d4-25a6af76997c service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=5ba208bf-2519-4a15-b4f5-8246cedadc63 HTTP/1.1" status: 200  len: 217 time: 0.0684278
Jun 01 06:17:19.707113 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-02e22e25-1aed-40b1-90fc-2e8e1d742e0f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:19.708683 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-02e22e25-1aed-40b1-90fc-2e8e1d742e0f service neutron] 10.222.0.48 "GET /v2.0/subnets?id=cdffe000-7f35-495d-a741-b4c48a060887 HTTP/1.1" status: 200  len: 850 time: 0.0625110
Jun 01 06:17:19.851680 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78c2ae0a-2b39-4891-a5cd-6dc00fb967b0 req-3192a722-69ed-4ac9-ae37-7a17f08dc038 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:19.853073 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-78c2ae0a-2b39-4891-a5cd-6dc00fb967b0 req-3192a722-69ed-4ac9-ae37-7a17f08dc038 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 943 time: 0.1399791
Jun 01 06:17:19.858044 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-04aa7ba6-0873-465e-8aab-8809f4e3b0a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:19.859391 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-04aa7ba6-0873-465e-8aab-8809f4e3b0a8 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=028fef0a-f05a-48d5-ba5c-b539846209ba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1159003
Jun 01 06:17:20.062920 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-78c2ae0a-2b39-4891-a5cd-6dc00fb967b0 req-8b21ff19-0144-4985-93fd-eb0e199b9c17 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2025640
Jun 01 06:17:20.125181 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-dd48afaf-16f3-4e62-a890-5c869c051fb3 service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2470667
Jun 01 06:17:20.265815 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a27e421b-4131-4e45-8a67-5e4b528e6eaa req-b7613858-f57f-42e9-ad16-bc3f8ff1bdce service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1331024
Jun 01 06:17:20.384395 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7725b90c-f717-4859-bbff-2783c89302b1 req-1eea7b05-fadc-461d-ab8f-0e2dbc514710 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:20.386371 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7725b90c-f717-4859-bbff-2783c89302b1 req-1eea7b05-fadc-461d-ab8f-0e2dbc514710 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=e8bcff3fed924886a68a8562a9f4f8f3&device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 1096 time: 0.0738366
Jun 01 06:17:20.529747 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7725b90c-f717-4859-bbff-2783c89302b1 req-cb68582b-ad42-45e2-92f7-743d4ba9016e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:20.531409 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7725b90c-f717-4859-bbff-2783c89302b1 req-cb68582b-ad42-45e2-92f7-743d4ba9016e service neutron] 10.222.0.48 "GET /v2.0/networks?id=028fef0a-f05a-48d5-ba5c-b539846209ba HTTP/1.1" status: 200  len: 912 time: 0.1377797
Jun 01 06:17:20.606484 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7725b90c-f717-4859-bbff-2783c89302b1 req-b5046d04-931d-4ee9-ac77-1b8e2683384b service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=5ba208bf-2519-4a15-b4f5-8246cedadc63 HTTP/1.1" status: 200  len: 217 time: 0.0681429
Jun 01 06:17:20.675987 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7725b90c-f717-4859-bbff-2783c89302b1 req-2c9bd354-0ddd-4851-ab7c-00385003d471 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:20.677460 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7725b90c-f717-4859-bbff-2783c89302b1 req-2c9bd354-0ddd-4851-ab7c-00385003d471 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=cdffe000-7f35-495d-a741-b4c48a060887 HTTP/1.1" status: 200  len: 850 time: 0.0638688
Jun 01 06:17:20.692803 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:17:20.825194 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de1e1d85-1a8a-489e-ba0b-9e553cdd14e2 req-9c8ce6af-efc0-4806-b736-8124fa5bcced tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:20.826776 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-de1e1d85-1a8a-489e-ba0b-9e553cdd14e2 req-9c8ce6af-efc0-4806-b736-8124fa5bcced tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 945 time: 0.1463482
Jun 01 06:17:20.858005 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=3a7e88d5-0834-4e15-acbc-90cd1b9bca61,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:17:20.858456 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7725b90c-f717-4859-bbff-2783c89302b1 req-d2df08e3-143f-4c0e-8fd1-2dc5b8e9629d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:20.860159 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7725b90c-f717-4859-bbff-2783c89302b1 req-d2df08e3-143f-4c0e-8fd1-2dc5b8e9629d service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=028fef0a-f05a-48d5-ba5c-b539846209ba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1432188
Jun 01 06:17:20.873086 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'port_id': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61', 'mac_address': 'fa:16:3e:84:9b:48', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 245, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:17:20.905186 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-de1e1d85-1a8a-489e-ba0b-9e553cdd14e2 req-a87e9060-40b2-4cfb-b8f5-e086f63de18f tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0710485
Jun 01 06:17:20.957086 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:20.975260 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:17:20.992912 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=3a7e88d5-0834-4e15-acbc-90cd1b9bca61,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:17:20.998714 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:21.001200 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:21.029530 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7725b90c-f717-4859-bbff-2783c89302b1 req-f011a564-684a-4377-b3f4-184b349fca46 service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1565471
Jun 01 06:17:21.086561 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=3a7e88d5-0834-4e15-acbc-90cd1b9bca61,revision_number=6']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:21.099665 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:21.129162 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['3a7e88d5-0834-4e15-acbc-90cd1b9bca61'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:17:21.199947 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7725b90c-f717-4859-bbff-2783c89302b1 req-5b3cac10-fdec-4484-a7af-726f98475322 service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1612709
Jun 01 06:17:21.309203 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7521c3a3-3482-4006-8405-c60c17807e2f req-d04a3fdd-9ecc-4f08-9078-3de96b104b76 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:21.311021 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7521c3a3-3482-4006-8405-c60c17807e2f req-d04a3fdd-9ecc-4f08-9078-3de96b104b76 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 943 time: 0.0940425
Jun 01 06:17:21.367657 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7521c3a3-3482-4006-8405-c60c17807e2f req-f9af90fc-7ada-4213-9cd2-de585909adb7 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0496068
Jun 01 06:17:22.222628 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8ac820f-ce27-4460-94ad-7f555087ef0e req-578e60c1-eb30-4aa1-a49f-5b535faf5374 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:22.224156 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a8ac820f-ce27-4460-94ad-7f555087ef0e req-578e60c1-eb30-4aa1-a49f-5b535faf5374 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 944 time: 0.1940694
Jun 01 06:17:22.293963 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a8ac820f-ce27-4460-94ad-7f555087ef0e req-3dd5e551-b1ad-43e2-b13b-8c82e64a0754 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0630267
Jun 01 06:17:22.588743 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d145542-4454-488d-ad54-c08b50f0c264 req-41c551d6-a377-4244-9b4d-01e01a0555fe tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:22.590249 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7d145542-4454-488d-ad54-c08b50f0c264 req-41c551d6-a377-4244-9b4d-01e01a0555fe tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 943 time: 0.1045852
Jun 01 06:17:22.648596 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7d145542-4454-488d-ad54-c08b50f0c264 req-94b9f3ba-2442-4a56-8dca-43e8c4311ba9 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0504861
Jun 01 06:17:22.700665 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:17:22.793821 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:17:22.794209 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:22.992312 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:23.032347 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0504a6b7-2f41-4914-a3bb-2f908556d658', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:17:23.035212 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-279e2b46-6a4c-4e5a-bb96-3aa38da17818" -d '{"events": [{"server_uuid": "0504a6b7-2f41-4914-a3bb-2f908556d658", "name": "network-vif-plugged", "status": "completed", "tag": "3a7e88d5-0834-4e15-acbc-90cd1b9bca61"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:17:23.058120 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=3a7e88d5-0834-4e15-acbc-90cd1b9bca61,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:17:23.067419 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:23.071660 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:23.127793 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:17:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c9ae6daa-8c6f-4fc7-adaa-183f48f72400 x-openstack-request-id: req-c9ae6daa-8c6f-4fc7-adaa-183f48f72400 {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:17:23.128235 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0504a6b7-2f41-4914-a3bb-2f908556d658", "name": "network-vif-plugged", "status": "completed", "tag": "3a7e88d5-0834-4e15-acbc-90cd1b9bca61", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:17:23.128524 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-c9ae6daa-8c6f-4fc7-adaa-183f48f72400 {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:17:23.128932 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0504a6b7-2f41-4914-a3bb-2f908556d658', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61', 'code': 200}
Jun 01 06:17:23.180394 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=3a7e88d5-0834-4e15-acbc-90cd1b9bca61,revision_number=7']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:23.184656 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:23.505288 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d466e44-96ab-45ea-949e-618865a5cb73 req-96f0a22f-5ccf-4ed6-aa30-1339bdfc5ee2 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:23.507086 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9d466e44-96ab-45ea-949e-618865a5cb73 req-96f0a22f-5ccf-4ed6-aa30-1339bdfc5ee2 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 945 time: 0.0949974
Jun 01 06:17:23.556640 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9d466e44-96ab-45ea-949e-618865a5cb73 req-a71311d8-51e4-46dc-b6ca-3a853d0a896d tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0437536
Jun 01 06:17:23.871737 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb7b7f51-ec24-4210-b524-29fee43e9e07 req-8212a766-9bf9-44a5-804e-6ac47fb174da tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:23.873290 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cb7b7f51-ec24-4210-b524-29fee43e9e07 req-8212a766-9bf9-44a5-804e-6ac47fb174da tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 943 time: 0.1038554
Jun 01 06:17:23.928683 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cb7b7f51-ec24-4210-b524-29fee43e9e07 req-dc8479ff-5e97-448b-9d41-cb79ef77190e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0482516
Jun 01 06:17:24.768011 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9325d65-d47a-4b13-b1c5-4176e4f80ab2 req-f01275f8-06b2-4fe5-8440-e0e55abcfadb tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:24.769766 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f9325d65-d47a-4b13-b1c5-4176e4f80ab2 req-f01275f8-06b2-4fe5-8440-e0e55abcfadb tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 945 time: 0.0901549
Jun 01 06:17:24.818371 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f9325d65-d47a-4b13-b1c5-4176e4f80ab2 req-c74d47f6-4a09-4ad4-924e-e1dd2e8fe08a tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0418088
Jun 01 06:17:25.260945 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b26b832-c9b3-42eb-83a5-a4ef99edf843 req-0b8e7247-bd9f-4604-842e-dcc01a1c92e9 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:25.262483 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0b26b832-c9b3-42eb-83a5-a4ef99edf843 req-0b8e7247-bd9f-4604-842e-dcc01a1c92e9 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 943 time: 0.2079728
Jun 01 06:17:25.313280 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0b26b832-c9b3-42eb-83a5-a4ef99edf843 req-98405757-3be9-4ce2-bda0-cd8c32888c92 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0448096
Jun 01 06:17:26.037521 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ee5ef94-46d1-4cc0-b398-d105de3134e0 req-dde8e877-724f-4fd8-aa31-4a3445326a64 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:26.037521 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3ee5ef94-46d1-4cc0-b398-d105de3134e0 req-dde8e877-724f-4fd8-aa31-4a3445326a64 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 945 time: 0.0871358
Jun 01 06:17:26.106237 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3ee5ef94-46d1-4cc0-b398-d105de3134e0 req-416bf59f-01b2-4866-955b-70ba37a13c4a tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0598228
Jun 01 06:17:26.541029 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96d1a25b-e589-46d5-8952-45594fe3a5a2 req-c88e7b6d-e44c-4732-bc9a-0a34da91968c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:26.544630 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-96d1a25b-e589-46d5-8952-45594fe3a5a2 req-c88e7b6d-e44c-4732-bc9a-0a34da91968c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 943 time: 0.1058247
Jun 01 06:17:26.599144 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-96d1a25b-e589-46d5-8952-45594fe3a5a2 req-49a0e13f-5383-4609-9ebf-93bddc12ccf4 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0480118
Jun 01 06:17:27.377554 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc5192f4-60a1-4b01-9fbc-2001526faa2e req-d49ab356-e87b-4130-a28c-a2f3dacfd065 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:27.381059 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cc5192f4-60a1-4b01-9fbc-2001526faa2e req-d49ab356-e87b-4130-a28c-a2f3dacfd065 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 945 time: 0.1079326
Jun 01 06:17:27.435827 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cc5192f4-60a1-4b01-9fbc-2001526faa2e req-847eb4f0-9e32-494b-a58b-7e6282eecff0 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0503995
Jun 01 06:17:27.864735 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20bb5e99-5977-42ed-a8f7-7cc6c9bf8000 req-776f5fd9-0a27-41d3-97aa-ffe9517164ca tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:27.866579 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-20bb5e99-5977-42ed-a8f7-7cc6c9bf8000 req-776f5fd9-0a27-41d3-97aa-ffe9517164ca tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 943 time: 0.1249125
Jun 01 06:17:27.928765 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-20bb5e99-5977-42ed-a8f7-7cc6c9bf8000 req-38929b9b-43d1-4fb7-b1cf-4343ca2ea442 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0535872
Jun 01 06:17:28.660334 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54e7ced4-61bd-4df3-8611-d03dcdb2fbe1 req-95edcdb0-fee8-4384-8aef-42a9af432d4b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:28.663851 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-54e7ced4-61bd-4df3-8611-d03dcdb2fbe1 req-95edcdb0-fee8-4384-8aef-42a9af432d4b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 945 time: 0.1021276
Jun 01 06:17:28.718139 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 5ba208bf-2519-4a15-b4f5-8246cedadc63 details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:17:28.734016 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-54e7ced4-61bd-4df3-8611-d03dcdb2fbe1 req-d92f1061-a3e3-4d62-8eb9-9f04b8faeaec tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0657773
Jun 01 06:17:28.883826 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 5ba208bf-2519-4a15-b4f5-8246cedadc63, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=5ba208bf-2519-4a15-b4f5-8246cedadc63,segment=NetworkSegment(e9a368be-e119-4f56-bdcc-b9d10543e0d8),segment_id=e9a368be-e119-4f56-bdcc-b9d10543e0d8)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:17:28.898528 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': '5ba208bf-2519-4a15-b4f5-8246cedadc63', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'port_id': '5ba208bf-2519-4a15-b4f5-8246cedadc63', 'mac_address': 'fa:16:3e:bd:39:a0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 209, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:17:28.962337 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:28.985627 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5ba208bf-2519-4a15-b4f5-8246cedadc63 {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:17:29.008256 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 5ba208bf-2519-4a15-b4f5-8246cedadc63, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=5ba208bf-2519-4a15-b4f5-8246cedadc63,segment=NetworkSegment(e9a368be-e119-4f56-bdcc-b9d10543e0d8),segment_id=e9a368be-e119-4f56-bdcc-b9d10543e0d8)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:17:29.014417 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:29.016352 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-73776254-92d4-44e9-a44a-d9dc801b6647 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:29.108678 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=5ba208bf-2519-4a15-b4f5-8246cedadc63,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:29.120848 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:29.139215 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe2eb04e-2dec-42e0-8863-45b7fc950285 req-3a3c046b-841f-4da7-ae69-d829a1aecdb3 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:29.144270 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fe2eb04e-2dec-42e0-8863-45b7fc950285 req-3a3c046b-841f-4da7-ae69-d829a1aecdb3 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 944 time: 0.1003315
Jun 01 06:17:29.207287 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fe2eb04e-2dec-42e0-8863-45b7fc950285 req-fb195191-2ea9-49ca-8b06-5e195f9506e5 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0607674
Jun 01 06:17:29.428753 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['5ba208bf-2519-4a15-b4f5-8246cedadc63'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:17:29.933226 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f6597e2-6c70-4da2-ab94-c98107f87c8c req-7b4ad2c8-648d-4f4a-9087-d3794cac377c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:29.934628 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5f6597e2-6c70-4da2-ab94-c98107f87c8c req-7b4ad2c8-648d-4f4a-9087-d3794cac377c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 945 time: 0.0850792
Jun 01 06:17:29.983121 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5f6597e2-6c70-4da2-ab94-c98107f87c8c req-aa9c3376-00fb-464b-849b-66f605ebdc55 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0425060
Jun 01 06:17:30.478632 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-697ded4f-0f92-4c57-b817-5a2101516da4 req-f4d0d9c4-af7b-4564-996d-87a762ea5b32 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:30.480794 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-697ded4f-0f92-4c57-b817-5a2101516da4 req-f4d0d9c4-af7b-4564-996d-87a762ea5b32 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 944 time: 0.1515479
Jun 01 06:17:30.486311 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-942a5c4d-d7b7-46f7-8eee-6352cfc85a82 req-c7cb595d-8525-4f10-b3c9-3a2231bff007 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:30.487691 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-942a5c4d-d7b7-46f7-8eee-6352cfc85a82 req-c7cb595d-8525-4f10-b3c9-3a2231bff007 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=0f63ca6fed3e47a6a676979240aef5c0&device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 1098 time: 0.1231697
Jun 01 06:17:30.608200 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-697ded4f-0f92-4c57-b817-5a2101516da4 req-ae9180df-db41-4168-8b4b-51aa710320ab tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1195266
Jun 01 06:17:30.652844 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-942a5c4d-d7b7-46f7-8eee-6352cfc85a82 req-be2b9472-6888-4b1e-9faa-49588ebd8fbc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:30.654280 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-942a5c4d-d7b7-46f7-8eee-6352cfc85a82 req-be2b9472-6888-4b1e-9faa-49588ebd8fbc service neutron] 10.222.0.48 "GET /v2.0/networks?id=5f973ed4-521b-4b78-9a54-1336b1302fa2 HTTP/1.1" status: 200  len: 917 time: 0.1514182
Jun 01 06:17:30.729773 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 5ba208bf-2519-4a15-b4f5-8246cedadc63 up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:17:30.763104 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-942a5c4d-d7b7-46f7-8eee-6352cfc85a82 req-d82fca8a-19e0-4747-b148-e73c6b467509 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=3a7e88d5-0834-4e15-acbc-90cd1b9bca61 HTTP/1.1" status: 200  len: 999 time: 0.1015244
Jun 01 06:17:30.804571 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning for port 5ba208bf-2519-4a15-b4f5-8246cedadc63 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:17:30.810929 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port 5ba208bf-2519-4a15-b4f5-8246cedadc63 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:17:30.811304 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:30.836380 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-942a5c4d-d7b7-46f7-8eee-6352cfc85a82 req-9a2b992e-d66a-4c88-acfa-0c4cecae37d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:30.837904 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-942a5c4d-d7b7-46f7-8eee-6352cfc85a82 req-9a2b992e-d66a-4c88-acfa-0c4cecae37d4 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=6137ee10-ce13-45c9-8edb-31811502bfd7 HTTP/1.1" status: 200  len: 855 time: 0.0675795
Jun 01 06:17:30.926680 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-942a5c4d-d7b7-46f7-8eee-6352cfc85a82 req-9e84647f-5608-4ce9-9e8f-85ebc5369b39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:30.928604 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-942a5c4d-d7b7-46f7-8eee-6352cfc85a82 req-9e84647f-5608-4ce9-9e8f-85ebc5369b39 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=5f973ed4-521b-4b78-9a54-1336b1302fa2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0828321
Jun 01 06:17:30.958679 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:30.989373 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c3152e52-efff-440c-a60c-0c4b931f7132', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5ba208bf-2519-4a15-b4f5-8246cedadc63'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:17:30.991958 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bef52427-da6b-4545-b345-f953e613eab3" -d '{"events": [{"server_uuid": "c3152e52-efff-440c-a60c-0c4b931f7132", "name": "network-vif-plugged", "status": "completed", "tag": "5ba208bf-2519-4a15-b4f5-8246cedadc63"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:17:31.001117 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 5ba208bf-2519-4a15-b4f5-8246cedadc63, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=5ba208bf-2519-4a15-b4f5-8246cedadc63,segment=NetworkSegment(e9a368be-e119-4f56-bdcc-b9d10543e0d8),segment_id=e9a368be-e119-4f56-bdcc-b9d10543e0d8)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:17:31.006765 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:31.011728 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:31.071705 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:17:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-996ad35c-cd19-4d59-b032-82e8d0ef85d2 x-openstack-request-id: req-996ad35c-cd19-4d59-b032-82e8d0ef85d2 {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:17:31.071985 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c3152e52-efff-440c-a60c-0c4b931f7132", "name": "network-vif-plugged", "status": "completed", "tag": "5ba208bf-2519-4a15-b4f5-8246cedadc63", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:17:31.073067 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-996ad35c-cd19-4d59-b032-82e8d0ef85d2 {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:17:31.073651 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c3152e52-efff-440c-a60c-0c4b931f7132', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5ba208bf-2519-4a15-b4f5-8246cedadc63', 'code': 200}
Jun 01 06:17:31.078371 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-942a5c4d-d7b7-46f7-8eee-6352cfc85a82 req-4f91dbd5-d434-4dd7-aeb5-bde04bb06c8f service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1414871
Jun 01 06:17:31.094459 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=5ba208bf-2519-4a15-b4f5-8246cedadc63,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:31.105773 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:31.276906 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-942a5c4d-d7b7-46f7-8eee-6352cfc85a82 req-755d0114-d280-4e92-a846-72c1697a6452 service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1900020
Jun 01 06:17:31.295474 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-445dc685-ae5f-400a-9d81-606f6c97146b req-8e7ca58d-2dfc-4cc0-88ae-d4f6b3a90559 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:31.297002 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-445dc685-ae5f-400a-9d81-606f6c97146b req-8e7ca58d-2dfc-4cc0-88ae-d4f6b3a90559 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 945 time: 0.1377099
Jun 01 06:17:31.472446 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-445dc685-ae5f-400a-9d81-606f6c97146b req-2e6d4ed9-7dee-4ef1-858e-2bafad9c0d69 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1688371
Jun 01 06:17:31.488568 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0af9ea53-14ca-43d8-ae1c-f5f111ae48b7 req-2da0f2fe-3a35-4d10-9777-e1826bba20c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:31.490068 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0af9ea53-14ca-43d8-ae1c-f5f111ae48b7 req-2da0f2fe-3a35-4d10-9777-e1826bba20c7 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 1098 time: 0.0941823
Jun 01 06:17:31.540851 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0af9ea53-14ca-43d8-ae1c-f5f111ae48b7 req-7feac602-9811-4fbf-bb43-b557197257a8 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0391531
Jun 01 06:17:31.797582 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76c830f7-95d8-4a8a-8290-171d89d55269 req-ea87e2c2-1edd-426c-8fb4-e8bfc995342d tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:31.799053 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-76c830f7-95d8-4a8a-8290-171d89d55269 req-ea87e2c2-1edd-426c-8fb4-e8bfc995342d tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 945 time: 0.0828156
Jun 01 06:17:31.845281 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-76c830f7-95d8-4a8a-8290-171d89d55269 req-398496b6-c03a-46c7-afdc-6f3951fbf465 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0405326
Jun 01 06:17:32.677131 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0300a6c0-e9f4-44b1-8ed6-e07264f693f5 req-deb686a1-ec01-4232-aafb-9df0ec461fd9 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:32.678610 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0300a6c0-e9f4-44b1-8ed6-e07264f693f5 req-deb686a1-ec01-4232-aafb-9df0ec461fd9 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 945 time: 0.0919614
Jun 01 06:17:32.763335 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0300a6c0-e9f4-44b1-8ed6-e07264f693f5 req-b3c64d8c-edd3-443c-be7b-d90e72137871 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0781879
Jun 01 06:17:32.805894 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb70bed8-c4c8-4005-ae24-8738a11bacbe req-514f202c-9912-48f0-8f58-cbab497115ea tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:32.807316 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cb70bed8-c4c8-4005-ae24-8738a11bacbe req-514f202c-9912-48f0-8f58-cbab497115ea tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=99254438-3376-4397-ae41-1667e451ba6e HTTP/1.1" status: 200  len: 945 time: 0.0893486
Jun 01 06:17:32.852771 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cb70bed8-c4c8-4005-ae24-8738a11bacbe req-1b701101-1eff-46dc-9091-9f1a01ed9d45 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=7b7f5fd5-de63-4478-8c7a-1d742b2fa2da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0389583
Jun 01 06:17:33.035526 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79ebcc99-f38b-4ba6-9c0b-632c0851dbe4 req-2248052e-34b9-4a91-a567-eb11814cc77d tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:33.037020 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-79ebcc99-f38b-4ba6-9c0b-632c0851dbe4 req-2248052e-34b9-4a91-a567-eb11814cc77d tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 945 time: 0.0848017
Jun 01 06:17:33.082811 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-79ebcc99-f38b-4ba6-9c0b-632c0851dbe4 req-4e221397-8b88-42a8-a11f-81a1f47e974a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0390937
Jun 01 06:17:33.271882 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f062c1db-73e8-4504-a55a-5b32aae52229 req-cb64a30c-e8a6-4463-b01b-70a03a260cab tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:33.273357 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f062c1db-73e8-4504-a55a-5b32aae52229 req-cb64a30c-e8a6-4463-b01b-70a03a260cab tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 945 time: 0.0826597
Jun 01 06:17:33.318610 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f062c1db-73e8-4504-a55a-5b32aae52229 req-b6d44249-14d3-4736-9b97-da58feb7bfa2 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0387640
Jun 01 06:17:33.343350 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 39006) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:33.417271 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3083e2a0-1a60-43f2-b0e2-0ad510fc8b03 tempest-TestVolumeBootPattern-1044736619 tempest-TestVolumeBootPattern-1044736619-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:33.421178 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-3083e2a0-1a60-43f2-b0e2-0ad510fc8b03 tempest-TestVolumeBootPattern-1044736619 tempest-TestVolumeBootPattern-1044736619-project-admin] 10.222.0.25 "GET /v2.0/ports?device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 1093 time: 0.0740535
Jun 01 06:17:33.421354 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 39010) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:33.426351 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Request body: {'floatingip': {'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'port_id': '5ba208bf-2519-4a15-b4f5-8246cedadc63', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'fixed_ip_address': '172.20.0.7'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:17:33.432263 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:17:33.436370 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Usage tracker for resource:floatingip and tenant:e8bcff3fed924886a68a8562a9f4f8f3 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:17:33.439266 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:17:33.445783 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:17:33.457415 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for floatingip, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:33.602051 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:33.744726 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Allocated IP 172.27.2.125 (83b812fb-2cfc-46e4-baa4-745218ea3ed2/a59d7d11-a92c-4b4f-83cf-2095ecee2b51/47d251d3-f820-4ad3-a503-423d3e33b6ed) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:17:33.950734 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:34.066810 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db1c35ac-5382-4bd7-9215-067b651844f8 req-085d1c0a-22f2-4e83-a68a-0c59e3a73eba tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:34.068319 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-db1c35ac-5382-4bd7-9215-067b651844f8 req-085d1c0a-22f2-4e83-a68a-0c59e3a73eba tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 945 time: 0.1798718
Jun 01 06:17:34.074908 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:34.081589 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-0c0d3e74-5141-45ca-8e58-f155a216b72b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:34.167724 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:17:34.175244 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:17:34.188007 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55309dfa-a5c3-44ce-aab1-fb4ba04615eb req-4c3df182-bc34-4191-86e8-1ff8f73723fa tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:34.189744 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-55309dfa-a5c3-44ce-aab1-fb4ba04615eb req-4c3df182-bc34-4191-86e8-1ff8f73723fa tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=99254438-3376-4397-ae41-1667e451ba6e HTTP/1.1" status: 200  len: 945 time: 0.2181277
Jun 01 06:17:34.193040 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:17:34.243812 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Pushing event updated for resources: {'Port': ['ID=47d251d3-f820-4ad3-a503-423d3e33b6ed,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:34.281215 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-db1c35ac-5382-4bd7-9215-067b651844f8 req-c14bdaf4-1172-4dc7-b7ad-d724db5e6ba4 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2023666
Jun 01 06:17:34.285412 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:34.285793 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:34.286157 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:34.286510 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:34.286856 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:34.287204 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:34.287550 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:34.287920 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:34.288267 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:34.288614 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:34.288952 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:34.289286 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:34.303366 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:34.348575 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-55309dfa-a5c3-44ce-aab1-fb4ba04615eb req-b5e307fe-e8af-4fe7-86ed-919b9bd5fa78 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=7b7f5fd5-de63-4478-8c7a-1d742b2fa2da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1128287
Jun 01 06:17:34.749413 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:17:34.825146 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f922a0a-ae51-4977-8768-35ada217e176 req-2ebe4e7a-6859-4549-8ff4-9290e6157e02 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:34.825146 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1f922a0a-ae51-4977-8768-35ada217e176 req-2ebe4e7a-6859-4549-8ff4-9290e6157e02 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.48 "GET /v2.0/ports?device_id=99254438-3376-4397-ae41-1667e451ba6e HTTP/1.1" status: 200  len: 945 time: 0.1454988
Jun 01 06:17:34.908878 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:34.938587 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0504a6b7-2f41-4914-a3bb-2f908556d658', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:17:34.940996 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-556ff3aa-7471-4faf-a35e-cbeb0fc9a771" -d '{"events": [{"server_uuid": "0504a6b7-2f41-4914-a3bb-2f908556d658", "name": "network-vif-unplugged", "status": "completed", "tag": "3a7e88d5-0834-4e15-acbc-90cd1b9bca61"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:17:34.955735 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=3a7e88d5-0834-4e15-acbc-90cd1b9bca61,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:17:34.962620 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:34.965938 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:34.976678 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:35.010131 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-1f922a0a-ae51-4977-8768-35ada217e176 req-84961748-8d8b-42e6-bc3d-a66be0f04455 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Deleting port 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:17:35.010597 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-1f922a0a-ae51-4977-8768-35ada217e176 req-84961748-8d8b-42e6-bc3d-a66be0f04455 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:35.011437 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 01 Jun 2021 06:17:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-17c49c64-76df-43bc-993c-84bc7e032e7f x-openstack-request-id: req-17c49c64-76df-43bc-993c-84bc7e032e7f {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:17:35.011947 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0504a6b7-2f41-4914-a3bb-2f908556d658", "name": "network-vif-unplugged", "status": "failed", "tag": "3a7e88d5-0834-4e15-acbc-90cd1b9bca61", "code": 422}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:17:35.012376 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-17c49c64-76df-43bc-993c-84bc7e032e7f {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:17:35.012936 dv-cinder-793885-1-iscsi neutron-server[92231]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '0504a6b7-2f41-4914-a3bb-2f908556d658', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61', 'code': 422} returned with failed status
Jun 01 06:17:35.053612 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=3a7e88d5-0834-4e15-acbc-90cd1b9bca61,revision_number=8']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:35.056732 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:35.154614 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:35.248873 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-1f922a0a-ae51-4977-8768-35ada217e176 req-84961748-8d8b-42e6-bc3d-a66be0f04455 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] For port 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=71f9d0f0-891d-4ab3-93a2-6ace16cac0a9,segment=NetworkSegment(5dda6d07-db2a-40a3-815e-42df1528c630),segment_id=5dda6d07-db2a-40a3-815e-42df1528c630)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:17:35.249247 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-1f922a0a-ae51-4977-8768-35ada217e176 req-84961748-8d8b-42e6-bc3d-a66be0f04455 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:35.780619 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:35.784892 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-1f922a0a-ae51-4977-8768-35ada217e176 req-84961748-8d8b-42e6-bc3d-a66be0f04455 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:35.785263 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-1f922a0a-ae51-4977-8768-35ada217e176 req-84961748-8d8b-42e6-bc3d-a66be0f04455 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-745720'] for floatingip, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:35.785568 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.db.l3_db [req-1f922a0a-ae51-4977-8768-35ada217e176 req-84961748-8d8b-42e6-bc3d-a66be0f04455 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Floating IP 0100ff6f-a2fa-45e1-8d71-0e51424da06c disassociated. External IP: 172.27.2.47, port: 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9.
Jun 01 06:17:35.785914 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-1f922a0a-ae51-4977-8768-35ada217e176 req-84961748-8d8b-42e6-bc3d-a66be0f04455 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Calling delete_port for 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 owned by compute:nova {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:17:35.834979 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2077419'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:35.846163 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be721db1-70ec-439d-9d3c-60d96a8daa2a req-eb49f5db-556d-41e9-b451-a6de9e24ae3a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:35.847630 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-be721db1-70ec-439d-9d3c-60d96a8daa2a req-eb49f5db-556d-41e9-b451-a6de9e24ae3a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=99254438-3376-4397-ae41-1667e451ba6e HTTP/1.1" status: 200  len: 945 time: 0.3603656
Jun 01 06:17:35.856587 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-7578aef3-22c7-4d78-a690-526512ca0777 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:36.049367 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Pushing event updated for resources: {'Port': ['ID=47d251d3-f820-4ad3-a503-423d3e33b6ed,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:36.058731 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-be721db1-70ec-439d-9d3c-60d96a8daa2a req-720ec1a8-38f9-48de-b3f0-280e9597da81 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups?id=7b7f5fd5-de63-4478-8c7a-1d742b2fa2da&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1686299
Jun 01 06:17:36.062877 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.206s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:36.070348 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-745720'] for floatingip, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:36.285647 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32232653-1e81-44dc-b43b-eac9a2214201 req-971bee7a-0e95-4ea5-bcc9-c9eb05ed6e0e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:36.287128 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-32232653-1e81-44dc-b43b-eac9a2214201 req-971bee7a-0e95-4ea5-bcc9-c9eb05ed6e0e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 943 time: 0.5599611
Jun 01 06:17:36.293525 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c6a28b84-4aa7-4d0a-822e-cd0194b677b2 req-23cca6b9-ed9e-43ef-b2ee-a98840c2106e service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.5236957
Jun 01 06:17:36.477779 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-32232653-1e81-44dc-b43b-eac9a2214201 req-48c71760-6f85-4cfe-841e-1f1e97aa35b5 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1807992
Jun 01 06:17:36.484009 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-1f922a0a-ae51-4977-8768-35ada217e176 req-84961748-8d8b-42e6-bc3d-a66be0f04455 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:36.486358 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.db.l3_db [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Floating IP 4292dbbd-2970-492d-a5df-e73465d512a2 associated. External IP: 172.27.2.125, port: 5ba208bf-2519-4a15-b4f5-8246cedadc63.
Jun 01 06:17:36.543262 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:36.612692 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84961748-8d8b-42e6-bc3d-a66be0f04455 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Pushing event deleted for resources: {'Port': ['ID=71f9d0f0-891d-4ab3-93a2-6ace16cac0a9,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:36.618833 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-84961748-8d8b-42e6-bc3d-a66be0f04455 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:36.957112 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.l3_agent_scheduler [req-1f922a0a-ae51-4977-8768-35ada217e176 req-84961748-8d8b-42e6-bc3d-a66be0f04455 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Router f8aef563-57d3-45c3-afd4-23442c8f572d has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92229) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:17:37.193986 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Router 00ab7a71-e7f7-4524-99c9-7562f23905d1 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92229) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:17:37.305562 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c2d1a0f4-ce9e-449f-8b5b-c5c33dd07670 req-6297e267-6370-4306-ac1a-e6c4e2f6d4c5 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=99254438-3376-4397-ae41-1667e451ba6e HTTP/1.1" status: 200  len: 210 time: 0.1136818
Jun 01 06:17:37.391522 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-1f922a0a-ae51-4977-8768-35ada217e176 req-84961748-8d8b-42e6-bc3d-a66be0f04455 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92229) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:17:37.402183 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67223fbf-b5ff-4f56-8c06-9b20c44d167c None None] Sync routers for ids ['f8aef563-57d3-45c3-afd4-23442c8f572d'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:17:37.411643 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67223fbf-b5ff-4f56-8c06-9b20c44d167c None None] Routers {'f8aef563-57d3-45c3-afd4-23442c8f572d'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:17:37.412294 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-67223fbf-b5ff-4f56-8c06-9b20c44d167c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b213d820>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:17:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['f8aef563-57d3-45c3-afd4-23442c8f572d'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:37.612437 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-67223fbf-b5ff-4f56-8c06-9b20c44d167c None None] Set router f8aef563-57d3-45c3-afd4-23442c8f572d gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:17:37.708289 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-1f922a0a-ae51-4977-8768-35ada217e176 req-84961748-8d8b-42e6-bc3d-a66be0f04455 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] No DVR routers for this DVR port 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 on host hv-cinder-79388 {{(pid=92229) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:17:37.724029 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-1f922a0a-ae51-4977-8768-35ada217e176 req-84961748-8d8b-42e6-bc3d-a66be0f04455 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:37.728699 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '99254438-3376-4397-ae41-1667e451ba6e', 'name': 'network-vif-deleted', 'tag': '71f9d0f0-891d-4ab3-93a2-6ace16cac0a9'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:17:37.731490 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-25aed965-2b9b-4565-a543-a7cfecfca8e7" -d '{"events": [{"server_uuid": "99254438-3376-4397-ae41-1667e451ba6e", "name": "network-vif-deleted", "tag": "71f9d0f0-891d-4ab3-93a2-6ace16cac0a9"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:17:37.777966 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6a28b84-4aa7-4d0a-822e-cd0194b677b2 req-3eeaf790-69df-4fba-9b73-020512029f0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:37.779354 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c6a28b84-4aa7-4d0a-822e-cd0194b677b2 req-3eeaf790-69df-4fba-9b73-020512029f0b service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658&tenant_id=0f63ca6fed3e47a6a676979240aef5c0 HTTP/1.1" status: 200  len: 1096 time: 0.5886834
Jun 01 06:17:37.784412 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1f922a0a-ae51-4977-8768-35ada217e176 req-84961748-8d8b-42e6-bc3d-a66be0f04455 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.48 "DELETE /v2.0/ports/71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 HTTP/1.1" status: 204  len: 173 time: 2.9514771
Jun 01 06:17:37.788371 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:17:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9e242571-4c4c-4aa5-a967-e5da41dbe04f x-openstack-request-id: req-9e242571-4c4c-4aa5-a967-e5da41dbe04f {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:17:37.788683 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "99254438-3376-4397-ae41-1667e451ba6e", "name": "network-vif-deleted", "tag": "71f9d0f0-891d-4ab3-93a2-6ace16cac0a9", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:17:37.788960 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-9e242571-4c4c-4aa5-a967-e5da41dbe04f {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:17:37.789367 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '99254438-3376-4397-ae41-1667e451ba6e', 'name': 'network-vif-deleted', 'tag': '71f9d0f0-891d-4ab3-93a2-6ace16cac0a9', 'status': 'completed', 'code': 200}
Jun 01 06:17:37.790472 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92229) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:17:37.803228 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12d30498-838d-4cdf-adc3-f9d0bb7bfe2a None None] Sync routers for ids ['00ab7a71-e7f7-4524-99c9-7562f23905d1'] in dv-cinder-793885-1-iscsi {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:17:37.820667 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12d30498-838d-4cdf-adc3-f9d0bb7bfe2a None None] Routers {'00ab7a71-e7f7-4524-99c9-7562f23905d1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:17:37.821610 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-12d30498-838d-4cdf-adc3-f9d0bb7bfe2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b33682b0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:17:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['00ab7a71-e7f7-4524-99c9-7562f23905d1'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:37.822636 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for floatingip, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:37.929414 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-608cc42b-e1e1-4a04-a24d-d86c03006e53 req-f47d5069-9ad1-432b-9338-0a7b2272464b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:37.930827 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-608cc42b-e1e1-4a04-a24d-d86c03006e53 req-f47d5069-9ad1-432b-9338-0a7b2272464b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 943 time: 0.2691329
Jun 01 06:17:37.984447 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 4.5620368
Jun 01 06:17:37.988552 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-67223fbf-b5ff-4f56-8c06-9b20c44d167c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b213d820>, [{'id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'name': 'tempest-AttachVolumeTestJSON-1575365070-router', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214'}], 'enable_snat': True}, 'gw_port_id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:23Z', 'updated_at': '2021-06-01T06:11:31Z', 'revision_number': 4, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'gw_port': {'id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:02:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '8e48657d-a82c-420f-8462-d947f458adb4', 'name': '', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'mac_address': 'fa:16:3e:9f:72:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '3e980239-de35-45a0-8039-8395b5408617', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:30Z', 'updated_at': '2021-06-01T06:11:46Z', 'revision_number': 5, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'subnets': [{'id': '3e980239-de35-45a0-8039-8395b5408617', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:37.992956 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67223fbf-b5ff-4f56-8c06-9b20c44d167c None None] Checking router: f8aef563-57d3-45c3-afd4-23442c8f572d for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:17:38.002801 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67223fbf-b5ff-4f56-8c06-9b20c44d167c None None] Routers {'f8aef563-57d3-45c3-afd4-23442c8f572d'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:17:38.003413 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-67223fbf-b5ff-4f56-8c06-9b20c44d167c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b213d820>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:17:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['f8aef563-57d3-45c3-afd4-23442c8f572d'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:38.017802 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-608cc42b-e1e1-4a04-a24d-d86c03006e53 req-836475d8-fd31-463a-907a-569092ae5c36 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0762129
Jun 01 06:17:38.027696 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6a28b84-4aa7-4d0a-822e-cd0194b677b2 req-af70661f-f277-4ffa-aa9a-a39c89599c12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:38.029284 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c6a28b84-4aa7-4d0a-822e-cd0194b677b2 req-af70661f-f277-4ffa-aa9a-a39c89599c12 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=0f63ca6fed3e47a6a676979240aef5c0&device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 1096 time: 0.1802619
Jun 01 06:17:38.058126 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-12d30498-838d-4cdf-adc3-f9d0bb7bfe2a None None] Set router 00ab7a71-e7f7-4524-99c9-7562f23905d1 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:17:38.172254 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6a28b84-4aa7-4d0a-822e-cd0194b677b2 req-8b8f34a9-8fb7-4d9a-8a44-f491159abacc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:38.173905 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c6a28b84-4aa7-4d0a-822e-cd0194b677b2 req-8b8f34a9-8fb7-4d9a-8a44-f491159abacc service neutron] 10.222.0.48 "GET /v2.0/networks?id=5f973ed4-521b-4b78-9a54-1336b1302fa2 HTTP/1.1" status: 200  len: 917 time: 0.1355233
Jun 01 06:17:38.187232 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-67223fbf-b5ff-4f56-8c06-9b20c44d167c None None] Set router f8aef563-57d3-45c3-afd4-23442c8f572d gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:17:38.293311 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c6a28b84-4aa7-4d0a-822e-cd0194b677b2 req-80910eaf-a9e5-4b05-9e46-7fff67887298 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=3a7e88d5-0834-4e15-acbc-90cd1b9bca61 HTTP/1.1" status: 200  len: 997 time: 0.1096535
Jun 01 06:17:38.404025 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6a28b84-4aa7-4d0a-822e-cd0194b677b2 req-c8426ac2-f2f1-47f6-901d-8d66c17181dd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:38.405615 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c6a28b84-4aa7-4d0a-822e-cd0194b677b2 req-c8426ac2-f2f1-47f6-901d-8d66c17181dd service neutron] 10.222.0.48 "GET /v2.0/subnets?id=6137ee10-ce13-45c9-8edb-31811502bfd7 HTTP/1.1" status: 200  len: 855 time: 0.1014352
Jun 01 06:17:38.462623 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-9b9e8468-5e51-4db0-a659-0f7abcfb4290 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:38.561246 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-12d30498-838d-4cdf-adc3-f9d0bb7bfe2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b33682b0>, [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '4292dbbd-2970-492d-a5df-e73465d512a2', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'floating_ip_address': '172.27.2.125', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'port_id': '5ba208bf-2519-4a15-b4f5-8246cedadc63', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 582, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'mac_address': 'fa:16:3e:bd:39:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3152e52-efff-440c-a60c-0c4b931f7132', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:17:34Z', 'updated_at': '2021-06-01T06:17:34Z', 'revision_number': 0, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cd6dda6e-46d3-4412-9652-c686f5fad712', 'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'mac_address': 'fa:16:3e:aa:f2:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:24Z', 'updated_at': '2021-06-01T06:13:41Z', 'revision_number': 5, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'subnets': [{'id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:38.566506 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12d30498-838d-4cdf-adc3-f9d0bb7bfe2a None None] Checking router: 00ab7a71-e7f7-4524-99c9-7562f23905d1 for host: dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:17:38.576701 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-1585306e-2be1-402d-95aa-4cc25407c09a req-1ecd6718-cdeb-4a9b-a8be-043e2d4db544 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Synchronizing usage tracker for tenant:ac4006667c3442a3910d548e9e9d22c0 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:17:38.585774 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12d30498-838d-4cdf-adc3-f9d0bb7bfe2a None None] Routers {'00ab7a71-e7f7-4524-99c9-7562f23905d1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:17:38.587063 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-12d30498-838d-4cdf-adc3-f9d0bb7bfe2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b33682b0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:17:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['00ab7a71-e7f7-4524-99c9-7562f23905d1'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:38.597649 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-67223fbf-b5ff-4f56-8c06-9b20c44d167c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b213d820>, [{'id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'name': 'tempest-AttachVolumeTestJSON-1575365070-router', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214'}], 'enable_snat': True}, 'gw_port_id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:23Z', 'updated_at': '2021-06-01T06:11:31Z', 'revision_number': 4, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'gw_port': {'id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:02:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '8e48657d-a82c-420f-8462-d947f458adb4', 'name': '', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'mac_address': 'fa:16:3e:9f:72:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '3e980239-de35-45a0-8039-8395b5408617', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:30Z', 'updated_at': '2021-06-01T06:11:46Z', 'revision_number': 5, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'subnets': [{'id': '3e980239-de35-45a0-8039-8395b5408617', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:38.605639 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67223fbf-b5ff-4f56-8c06-9b20c44d167c None None] The sync data for ids ['f8aef563-57d3-45c3-afd4-23442c8f572d'] in dv-cinder-793885-1-iscsi is: [{'id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'name': 'tempest-AttachVolumeTestJSON-1575365070-router', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214'}], 'enable_snat': True}, 'gw_port_id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:23Z', 'updated_at': '2021-06-01T06:11:31Z', 'revision_number': 4, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'gw_port': {'id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:02:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '8e48657d-a82c-420f-8462-d947f458adb4', 'name': '', 'network_id': '0890ab9c-2266-4ef4-af73-d3ff421b9bd7', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'mac_address': 'fa:16:3e:9f:72:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '3e980239-de35-45a0-8039-8395b5408617', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:30Z', 'updated_at': '2021-06-01T06:11:46Z', 'revision_number': 5, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'subnets': [{'id': '3e980239-de35-45a0-8039-8395b5408617', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:17:38.607466 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-1585306e-2be1-402d-95aa-4cc25407c09a req-1ecd6718-cdeb-4a9b-a8be-043e2d4db544 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Unset dirty status for tenant:ac4006667c3442a3910d548e9e9d22c0 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:17:38.608670 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1585306e-2be1-402d-95aa-4cc25407c09a req-1ecd6718-cdeb-4a9b-a8be-043e2d4db544 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/ports?device_id=99254438-3376-4397-ae41-1667e451ba6e HTTP/1.1" status: 200  len: 210 time: 0.1150315
Jun 01 06:17:38.615188 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6a28b84-4aa7-4d0a-822e-cd0194b677b2 req-89177844-c604-4258-8e21-91adb5b96323 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:38.616723 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c6a28b84-4aa7-4d0a-822e-cd0194b677b2 req-89177844-c604-4258-8e21-91adb5b96323 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=5f973ed4-521b-4b78-9a54-1336b1302fa2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2005920
Jun 01 06:17:38.743554 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:17:38.786901 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c6a28b84-4aa7-4d0a-822e-cd0194b677b2 req-d49c1583-5c64-4be6-ae84-a441d82fdb84 service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1579571
Jun 01 06:17:38.803231 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-12d30498-838d-4cdf-adc3-f9d0bb7bfe2a None None] Set router 00ab7a71-e7f7-4524-99c9-7562f23905d1 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:17:38.907092 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f09d94d-d010-403d-864f-ab9c9a22f375 None None] New status for floating IP 0100ff6f-a2fa-45e1-8d71-0e51424da06c: DOWN {{(pid=92231) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 06:17:38.970585 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:17:38.978755 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c6a28b84-4aa7-4d0a-822e-cd0194b677b2 req-526b550d-37fd-4e73-a943-82fe4ef6e041 service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1845586
Jun 01 06:17:39.026319 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] No Port match for: 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:17:39.026848 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 71f9d0f0-891d-4ab3-93a2-6ace16cac0a9 not bound to the agent host hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:17:39.254694 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5515b5a-99d8-42bb-ab1d-d40cac7ae3b2 req-125d9f02-7ce0-431e-a98a-3a868005f39d tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:39.256448 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b5515b5a-99d8-42bb-ab1d-d40cac7ae3b2 req-125d9f02-7ce0-431e-a98a-3a868005f39d tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 943 time: 0.0990820
Jun 01 06:17:39.269175 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-12d30498-838d-4cdf-adc3-f9d0bb7bfe2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b33682b0>, [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '4292dbbd-2970-492d-a5df-e73465d512a2', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'floating_ip_address': '172.27.2.125', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'port_id': '5ba208bf-2519-4a15-b4f5-8246cedadc63', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 582, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'mac_address': 'fa:16:3e:bd:39:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3152e52-efff-440c-a60c-0c4b931f7132', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:17:34Z', 'updated_at': '2021-06-01T06:17:34Z', 'revision_number': 0, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cd6dda6e-46d3-4412-9652-c686f5fad712', 'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'mac_address': 'fa:16:3e:aa:f2:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:24Z', 'updated_at': '2021-06-01T06:13:41Z', 'revision_number': 5, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'subnets': [{'id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:39.273461 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12d30498-838d-4cdf-adc3-f9d0bb7bfe2a None None] The sync data for ids ['00ab7a71-e7f7-4524-99c9-7562f23905d1'] in dv-cinder-793885-1-iscsi is: [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '4292dbbd-2970-492d-a5df-e73465d512a2', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'floating_ip_address': '172.27.2.125', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'port_id': '5ba208bf-2519-4a15-b4f5-8246cedadc63', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 582, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'mac_address': 'fa:16:3e:bd:39:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3152e52-efff-440c-a60c-0c4b931f7132', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:17:34Z', 'updated_at': '2021-06-01T06:17:34Z', 'revision_number': 0, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cd6dda6e-46d3-4412-9652-c686f5fad712', 'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'mac_address': 'fa:16:3e:aa:f2:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:24Z', 'updated_at': '2021-06-01T06:13:41Z', 'revision_number': 5, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'subnets': [{'id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:17:39.320412 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b5515b5a-99d8-42bb-ab1d-d40cac7ae3b2 req-bf9e7fea-08a2-400d-a13a-9be509db6fdb tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0513709
Jun 01 06:17:39.514294 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e3f8f10-8432-4305-8dab-9315b0a12d1c None None] New status for floating IP 4292dbbd-2970-492d-a5df-e73465d512a2: ACTIVE {{(pid=92232) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 06:17:39.734155 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:17:39.788359 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39102) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:39.791528 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c3152e52-efff-440c-a60c-0c4b931f7132', 'tag': '5ba208bf-2519-4a15-b4f5-8246cedadc63'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:17:39.794536 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-abf8fa5e-5b70-4ecf-95d3-6cddf0e92944" -d '{"events": [{"name": "network-changed", "server_uuid": "c3152e52-efff-440c-a60c-0c4b931f7132", "tag": "5ba208bf-2519-4a15-b4f5-8246cedadc63"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:17:39.867823 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:17:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d1d3a436-f5d2-4f9e-95fb-b97559020e32 x-openstack-request-id: req-d1d3a436-f5d2-4f9e-95fb-b97559020e32 {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:17:39.867823 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c3152e52-efff-440c-a60c-0c4b931f7132", "tag": "5ba208bf-2519-4a15-b4f5-8246cedadc63", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:17:39.868081 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-d1d3a436-f5d2-4f9e-95fb-b97559020e32 {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:17:39.868359 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c3152e52-efff-440c-a60c-0c4b931f7132', 'tag': '5ba208bf-2519-4a15-b4f5-8246cedadc63', 'status': 'completed', 'code': 200}
Jun 01 06:17:39.900570 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ed95a6f6-adf3-4a86-b5be-aa6597a6294a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:39.932748 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ed95a6f6-adf3-4a86-b5be-aa6597a6294a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:39.989696 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ed95a6f6-adf3-4a86-b5be-aa6597a6294a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:39.995372 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-cb431a7e-a3fe-472f-9d96-27a3d7702510 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:40.011865 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed95a6f6-adf3-4a86-b5be-aa6597a6294a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7b7f5fd5-de63-4478-8c7a-1d742b2fa2da,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:40.014619 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-ed95a6f6-adf3-4a86-b5be-aa6597a6294a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:40.021709 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ed95a6f6-adf3-4a86-b5be-aa6597a6294a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:40.025367 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-ed95a6f6-adf3-4a86-b5be-aa6597a6294a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "DELETE /v2.0/security-groups/7b7f5fd5-de63-4478-8c7a-1d742b2fa2da HTTP/1.1" status: 204  len: 168 time: 0.2334781
Jun 01 06:17:40.025670 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39108) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:40.044210 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.api.v2.resource [None req-755dfd5b-8c7b-475e-b569-c791d2c6d89b tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] show failed (client error): The resource could not be found.
Jun 01 06:17:40.047916 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-755dfd5b-8c7b-475e-b569-c791d2c6d89b tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "GET /v2.0/security-groups/7b7f5fd5-de63-4478-8c7a-1d742b2fa2da HTTP/1.1" status: 404  len: 347 time: 0.0179367
Jun 01 06:17:40.048128 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39112) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:40.290395 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-ff5e138d-feb5-41b3-b814-bfeeef725787 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Deleting port 91cf9071-1416-48a2-a730-f59d369efb5b {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:17:40.290736 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ff5e138d-feb5-41b3-b814-bfeeef725787 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:40.535303 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01fb8606-de52-4ac5-8b9e-c513ae18f44e req-81c62254-e0a9-4175-bd0b-1c0c115e0023 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:40.537030 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-01fb8606-de52-4ac5-8b9e-c513ae18f44e req-81c62254-e0a9-4175-bd0b-1c0c115e0023 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 943 time: 0.1030080
Jun 01 06:17:40.550703 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ff5e138d-feb5-41b3-b814-bfeeef725787 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:40.550937 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ff5e138d-feb5-41b3-b814-bfeeef725787 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:40.590023 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-01fb8606-de52-4ac5-8b9e-c513ae18f44e req-6d8a3a04-a9b5-49c8-813e-c9320ff011ba tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0453267
Jun 01 06:17:40.689350 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-ff5e138d-feb5-41b3-b814-bfeeef725787 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Calling delete_port for 91cf9071-1416-48a2-a730-f59d369efb5b owned by network:floatingip {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:17:40.819047 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ff5e138d-feb5-41b3-b814-bfeeef725787 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:40.823269 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-1d88f3b5-aba1-494c-a6a4-9751e2f9f9fb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:40.871741 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff5e138d-feb5-41b3-b814-bfeeef725787 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Pushing event deleted for resources: {'Port': ['ID=91cf9071-1416-48a2-a730-f59d369efb5b,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:40.874963 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-ff5e138d-feb5-41b3-b814-bfeeef725787 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:40.971236 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ff5e138d-feb5-41b3-b814-bfeeef725787 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks [] for floatingip, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:40.990040 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ff5e138d-feb5-41b3-b814-bfeeef725787 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for floatingip, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:40.991455 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-ff5e138d-feb5-41b3-b814-bfeeef725787 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] 10.222.0.25 "DELETE /v2.0/floatingips/0100ff6f-a2fa-45e1-8d71-0e51424da06c HTTP/1.1" status: 204  len: 168 time: 0.9421799
Jun 01 06:17:41.222198 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:41.799940 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e83bf61b-ba57-4793-a27d-42f907a52522 req-cfa8f097-6dc9-48b2-8216-a90cadc21d91 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:41.801530 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e83bf61b-ba57-4793-a27d-42f907a52522 req-cfa8f097-6dc9-48b2-8216-a90cadc21d91 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 943 time: 0.0963912
Jun 01 06:17:41.853757 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e83bf61b-ba57-4793-a27d-42f907a52522 req-2afae7c4-823b-4810-96be-7334beccc575 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0449386
Jun 01 06:17:42.351297 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-748100c9-2dca-47b3-9134-5adb04e87249 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:43.071725 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8150714a-fff2-449c-a07b-2c3434d7d805 req-621c6306-dfe1-45cb-8676-2008785c291b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:43.073852 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8150714a-fff2-449c-a07b-2c3434d7d805 req-621c6306-dfe1-45cb-8676-2008785c291b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 943 time: 0.0950274
Jun 01 06:17:43.132962 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8150714a-fff2-449c-a07b-2c3434d7d805 req-2e834652-8b69-4b96-bbd8-7e336a3bd1cc tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0510380
Jun 01 06:17:43.293228 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:43.621973 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6a07b5c-9ed8-44cf-8298-ab5e0a6a3fce req-6ff1fe77-2619-4c75-9438-ebb2bd3fe43a tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:43.623518 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b6a07b5c-9ed8-44cf-8298-ab5e0a6a3fce req-6ff1fe77-2619-4c75-9438-ebb2bd3fe43a tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.0984976
Jun 01 06:17:43.681605 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b6a07b5c-9ed8-44cf-8298-ab5e0a6a3fce req-15983aab-0e26-4189-b072-1c7b5a648644 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0475404
Jun 01 06:17:44.497480 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fd12368-9eee-4b10-9a63-050d312f2f1f req-7d54ba76-42c0-41ba-ad9b-b94231002f8e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:44.498939 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8fd12368-9eee-4b10-9a63-050d312f2f1f req-7d54ba76-42c0-41ba-ad9b-b94231002f8e tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 943 time: 0.1956995
Jun 01 06:17:44.556170 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8fd12368-9eee-4b10-9a63-050d312f2f1f req-78df5e51-2192-4356-a28e-42349abdfae0 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0507016
Jun 01 06:17:44.887279 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49bb9d1c-f9a0-4d2b-8e75-44c7643751b4 req-e2a65301-1844-470d-bc83-81d872d3de08 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:44.888874 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-49bb9d1c-f9a0-4d2b-8e75-44c7643751b4 req-e2a65301-1844-470d-bc83-81d872d3de08 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.0914412
Jun 01 06:17:44.955031 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-49bb9d1c-f9a0-4d2b-8e75-44c7643751b4 req-c8cbe600-06e1-442b-9db8-f6c15d2bb50d tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0558074
Jun 01 06:17:45.135943 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39164) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:45.402203 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:45.815935 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bb425bf-5124-4ae4-9504-8624add8ba31 req-e93429a9-032a-4687-ba8e-feaf70e7774a tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:45.830055 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3bb425bf-5124-4ae4-9504-8624add8ba31 req-e93429a9-032a-4687-ba8e-feaf70e7774a tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 943 time: 0.1408348
Jun 01 06:17:45.882724 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3bb425bf-5124-4ae4-9504-8624add8ba31 req-c3113388-b911-454f-bd22-b8816a37c836 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0514185
Jun 01 06:17:45.981882 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:46.078814 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a72b7b91-1b5a-4c0f-b7ed-c978f0bad569 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-744138'] for router_interface, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:46.210810 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b79d2d5f-da16-49bc-a4b1-f54c01f055e0 req-cf064bbf-c8f3-42b5-8433-39e77eb26b9e tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:46.213219 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b79d2d5f-da16-49bc-a4b1-f54c01f055e0 req-cf064bbf-c8f3-42b5-8433-39e77eb26b9e tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.1175625
Jun 01 06:17:46.316732 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b79d2d5f-da16-49bc-a4b1-f54c01f055e0 req-fc674d6a-f048-4adb-8614-0afa4b471f01 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0892615
Jun 01 06:17:46.615580 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-a72b7b91-1b5a-4c0f-b7ed-c978f0bad569 admin admin] Deleting port 8e48657d-a82c-420f-8462-d947f458adb4 {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:17:46.616199 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a72b7b91-1b5a-4c0f-b7ed-c978f0bad569 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:46.864491 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [None req-a72b7b91-1b5a-4c0f-b7ed-c978f0bad569 admin admin] For port 8e48657d-a82c-420f-8462-d947f458adb4, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=8e48657d-a82c-420f-8462-d947f458adb4,segment=NetworkSegment(5dda6d07-db2a-40a3-815e-42df1528c630),segment_id=5dda6d07-db2a-40a3-815e-42df1528c630)] {{(pid=92230) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:17:46.865106 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a72b7b91-1b5a-4c0f-b7ed-c978f0bad569 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:47.039552 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-a72b7b91-1b5a-4c0f-b7ed-c978f0bad569 admin admin] Calling delete_port for 8e48657d-a82c-420f-8462-d947f458adb4 owned by network:router_interface {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:17:47.161075 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfd17bc5-9afe-42fb-97a0-a8127371f623 req-68fa3865-80e5-416a-9f29-08136571f9d1 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:47.164202 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-dfd17bc5-9afe-42fb-97a0-a8127371f623 req-68fa3865-80e5-416a-9f29-08136571f9d1 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 943 time: 0.1179104
Jun 01 06:17:47.218116 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-dfd17bc5-9afe-42fb-97a0-a8127371f623 req-68fc3b11-65fb-40dc-b9c5-2e0602a50501 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0464172
Jun 01 06:17:47.392759 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a72b7b91-1b5a-4c0f-b7ed-c978f0bad569 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:47.397867 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-3baca69a-299f-47b9-a802-f804dd3d2f78 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:47.443113 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a72b7b91-1b5a-4c0f-b7ed-c978f0bad569 admin admin] Pushing event deleted for resources: {'Port': ['ID=8e48657d-a82c-420f-8462-d947f458adb4,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:47.448429 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-a72b7b91-1b5a-4c0f-b7ed-c978f0bad569 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:47.552872 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c0a7dc7-d752-4de7-a5b0-3d1519a4826a req-47814fff-4594-4c38-b746-5a18b661df49 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:47.555556 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0c0a7dc7-d752-4de7-a5b0-3d1519a4826a req-47814fff-4594-4c38-b746-5a18b661df49 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.1155193
Jun 01 06:17:47.637658 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0c0a7dc7-d752-4de7-a5b0-3d1519a4826a req-73c846d0-c416-437b-8748-ee433b77c6b2 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0718143
Jun 01 06:17:47.790863 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a72b7b91-1b5a-4c0f-b7ed-c978f0bad569 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-581113', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-746586'] for router_interface, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:48.201839 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a72b7b91-1b5a-4c0f-b7ed-c978f0bad569 admin admin] Router f8aef563-57d3-45c3-afd4-23442c8f572d has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92230) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:17:48.497944 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cebfc377-fe21-4b8e-9939-130e210b03ab req-ab609689-e9c7-4531-82ea-eb01590506b3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:48.500258 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cebfc377-fe21-4b8e-9939-130e210b03ab req-ab609689-e9c7-4531-82ea-eb01590506b3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 943 time: 0.1439447
Jun 01 06:17:48.518916 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a72b7b91-1b5a-4c0f-b7ed-c978f0bad569 admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:17:48.531963 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed207ef9-9aa5-4a42-9bd9-f77feeada2fc None None] Sync routers for ids ['f8aef563-57d3-45c3-afd4-23442c8f572d'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:17:48.539645 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-a72b7b91-1b5a-4c0f-b7ed-c978f0bad569 admin admin] 10.222.0.25 "PUT /v2.0/routers/f8aef563-57d3-45c3-afd4-23442c8f572d/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 3.4014769
Jun 01 06:17:48.542853 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39186) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:48.546243 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed207ef9-9aa5-4a42-9bd9-f77feeada2fc None None] Routers {'f8aef563-57d3-45c3-afd4-23442c8f572d'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:17:48.547243 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-ed207ef9-9aa5-4a42-9bd9-f77feeada2fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b26d35b0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:17:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['f8aef563-57d3-45c3-afd4-23442c8f572d'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:48.571148 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cebfc377-fe21-4b8e-9939-130e210b03ab req-f1a553a1-8557-4bfa-bbc2-60296a0443bf tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0656004
Jun 01 06:17:48.770265 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Notify callbacks [] for router, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:48.860838 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-ed207ef9-9aa5-4a42-9bd9-f77feeada2fc None None] Set router f8aef563-57d3-45c3-afd4-23442c8f572d gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:17:48.872075 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cc9095a-9c40-4e34-ab00-793c9d59f914 req-dc26ac8f-0180-45b7-8814-0a26b44f8fcc tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:48.873944 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3cc9095a-9c40-4e34-ab00-793c9d59f914 req-dc26ac8f-0180-45b7-8814-0a26b44f8fcc tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.1180615
Jun 01 06:17:48.936372 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3cc9095a-9c40-4e34-ab00-793c9d59f914 req-c467104e-c079-4241-9c2e-e03b93b45418 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0551300
Jun 01 06:17:48.995544 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:49.097806 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Deleting port 357a4df7-5d82-4e9d-b8d1-2190f63e3f9f {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:17:49.098144 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:49.235639 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-ed207ef9-9aa5-4a42-9bd9-f77feeada2fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b26d35b0>, [{'id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'name': 'tempest-AttachVolumeTestJSON-1575365070-router', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214'}], 'enable_snat': True}, 'gw_port_id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:23Z', 'updated_at': '2021-06-01T06:17:47Z', 'revision_number': 5, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'gw_port': {'id': '357a4df7-5d82-4e9d-b8d1-2190f63e3f9f', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:9a:02:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 76, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:25Z', 'updated_at': '2021-06-01T06:11:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:49.239824 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed207ef9-9aa5-4a42-9bd9-f77feeada2fc None None] Checking router: f8aef563-57d3-45c3-afd4-23442c8f572d for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:17:49.242967 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] For port 357a4df7-5d82-4e9d-b8d1-2190f63e3f9f, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=357a4df7-5d82-4e9d-b8d1-2190f63e3f9f,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92230) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:17:49.243436 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:49.253723 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed207ef9-9aa5-4a42-9bd9-f77feeada2fc None None] Routers {'f8aef563-57d3-45c3-afd4-23442c8f572d'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:17:49.254441 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-ed207ef9-9aa5-4a42-9bd9-f77feeada2fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b26d35b0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:17:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['f8aef563-57d3-45c3-afd4-23442c8f572d'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:49.385033 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Calling delete_port for 357a4df7-5d82-4e9d-b8d1-2190f63e3f9f owned by network:router_gateway {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:17:49.438301 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-ed207ef9-9aa5-4a42-9bd9-f77feeada2fc None None] Set router f8aef563-57d3-45c3-afd4-23442c8f572d gateway port host: None {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:17:49.558217 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:49.564786 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:49.611649 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-ed207ef9-9aa5-4a42-9bd9-f77feeada2fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b26d35b0>, [{'id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'name': 'tempest-AttachVolumeTestJSON-1575365070-router', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:23Z', 'updated_at': '2021-06-01T06:17:48Z', 'revision_number': 6, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'gw_port_host': None}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:49.616393 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed207ef9-9aa5-4a42-9bd9-f77feeada2fc None None] The sync data for ids ['f8aef563-57d3-45c3-afd4-23442c8f572d'] in dv-cinder-793885-1-iscsi is: [{'id': 'f8aef563-57d3-45c3-afd4-23442c8f572d', 'name': 'tempest-AttachVolumeTestJSON-1575365070-router', 'tenant_id': 'ac4006667c3442a3910d548e9e9d22c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:23Z', 'updated_at': '2021-06-01T06:17:48Z', 'revision_number': 6, 'project_id': 'ac4006667c3442a3910d548e9e9d22c0', 'gw_port_host': None}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:17:49.617288 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Pushing event deleted for resources: {'Port': ['ID=357a4df7-5d82-4e9d-b8d1-2190f63e3f9f,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:49.671933 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:49.672294 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:49.672624 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:49.672975 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:49.673324 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:49.673683 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:49.674029 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:49.674376 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:49.674838 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:49.675192 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:49.675535 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:49.675992 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:17:49.725210 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:49.764171 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-745687'] for router_gateway, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:49.842109 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0f9ac3c-d938-4144-9525-9081819e51b9 req-a0653c85-db12-4fc1-b1ed-10af803543bf tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:49.843882 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e0f9ac3c-d938-4144-9525-9081819e51b9 req-a0653c85-db12-4fc1-b1ed-10af803543bf tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 943 time: 0.1083274
Jun 01 06:17:49.925949 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e0f9ac3c-d938-4144-9525-9081819e51b9 req-03e195bb-0482-4ec1-9e45-71af77da9f10 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0699553
Jun 01 06:17:49.973071 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-748122', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-727'] for router, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:49.976869 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:50.016832 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-746854'] for router, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:50.017912 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Fanout notify agent at l3_agent the message router_deleted on router f8aef563-57d3-45c3-afd4-23442c8f572d {{(pid=92230) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 06:17:50.046902 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Notify callbacks [] for router, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:50.052696 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 39198) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:50.054477 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] 10.222.0.25 "DELETE /v2.0/routers/f8aef563-57d3-45c3-afd4-23442c8f572d HTTP/1.1" status: 204  len: 168 time: 1.5101430
Jun 01 06:17:50.227483 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_v2 [None req-4e17cb9c-e582-40ae-9442-e26752f66dce admin admin] Deleting subnet 3e980239-de35-45a0-8039-8395b5408617 {{(pid=92229) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 06:17:50.232856 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4e17cb9c-e582-40ae-9442-e26752f66dce admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:50.292341 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4e17cb9c-e582-40ae-9442-e26752f66dce admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2127096'] for subnet, precommit_delete_associations {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:50.338549 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8456525-5f8b-485f-98f9-c07faffdc419 req-63608404-2307-4e2c-ac46-80fb6b785089 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:50.338549 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a8456525-5f8b-485f-98f9-c07faffdc419 req-63608404-2307-4e2c-ac46-80fb6b785089 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.2116477
Jun 01 06:17:50.436576 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a8456525-5f8b-485f-98f9-c07faffdc419 req-165536f8-63c9-423a-bc70-882e9bad2d17 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0867360
Jun 01 06:17:50.533029 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4e17cb9c-e582-40ae-9442-e26752f66dce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8086245'] for subnet, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:50.574876 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 8e48657d-a82c-420f-8462-d947f458adb4 no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:17:50.615958 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: 8e48657d-a82c-420f-8462-d947f458adb4 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:17:50.617134 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 8e48657d-a82c-420f-8462-d947f458adb4 not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:17:50.869103 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4e17cb9c-e582-40ae-9442-e26752f66dce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8087120', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1981457', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2134750'] for subnet, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:50.878160 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b698e454-730e-46ee-9b1a-f41487fd89db admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:50.915319 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e17cb9c-e582-40ae-9442-e26752f66dce admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3e980239-de35-45a0-8039-8395b5408617,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:50.918920 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-4e17cb9c-e582-40ae-9442-e26752f66dce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:50.919968 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4e17cb9c-e582-40ae-9442-e26752f66dce admin admin] Notify callbacks [] for subnet, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:50.929403 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-4e17cb9c-e582-40ae-9442-e26752f66dce admin admin] 10.222.0.25 "DELETE /v2.0/subnets/3e980239-de35-45a0-8039-8395b5408617 HTTP/1.1" status: 204  len: 168 time: 0.8722019
Jun 01 06:17:50.929680 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 39202) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:50.930564 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33fd9f2d-0d1f-41e6-b694-74548d8cdabc None None] Network 0890ab9c-2266-4ef4-af73-d3ff421b9bd7 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:17:51.102985 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8063377'] for network, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:51.324761 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f97bea49-3280-476e-8c04-d0eedbbaa853 None None] DHCP port deletion for 0890ab9c-2266-4ef4-af73-d3ff421b9bd7 request from dv-cinder-793885-1-iscsi {{(pid=92231) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 06:17:51.395341 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-f97bea49-3280-476e-8c04-d0eedbbaa853 None None] Deleting port be4bfacb-b512-4361-b6c4-f38e7945c7aa {{(pid=92231) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:17:51.395706 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-f97bea49-3280-476e-8c04-d0eedbbaa853 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:51.452887 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf2e032e-b0c5-455e-b236-f7abc534649f req-ac3c46dc-9757-44e1-946b-df274656a91b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:51.455154 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-cf2e032e-b0c5-455e-b236-f7abc534649f req-ac3c46dc-9757-44e1-946b-df274656a91b service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=0f63ca6fed3e47a6a676979240aef5c0&device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 1096 time: 0.0893652
Jun 01 06:17:51.473714 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] Deleting port be4bfacb-b512-4361-b6c4-f38e7945c7aa {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:17:51.474052 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:51.511238 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-f97bea49-3280-476e-8c04-d0eedbbaa853 None None] For port be4bfacb-b512-4361-b6c4-f38e7945c7aa, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=be4bfacb-b512-4361-b6c4-f38e7945c7aa,segment=NetworkSegment(5dda6d07-db2a-40a3-815e-42df1528c630),segment_id=5dda6d07-db2a-40a3-815e-42df1528c630)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:17:51.511955 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-f97bea49-3280-476e-8c04-d0eedbbaa853 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:51.549593 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abf8fa5e-5b70-4ecf-95d3-6cddf0e92944 req-80450a1b-2357-45b0-8705-e31d941494e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:51.551111 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-abf8fa5e-5b70-4ecf-95d3-6cddf0e92944 req-80450a1b-2357-45b0-8705-e31d941494e6 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=e8bcff3fed924886a68a8562a9f4f8f3&device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 1098 time: 0.2648470
Jun 01 06:17:51.643554 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-f97bea49-3280-476e-8c04-d0eedbbaa853 None None] Calling delete_port for be4bfacb-b512-4361-b6c4-f38e7945c7aa owned by network:dhcp {{(pid=92231) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:17:51.648474 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce5c571a-c401-4633-b7cc-fcafc0e7661f req-d457cbad-d00f-42b1-9679-3f4fb2de00b0 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:51.650039 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ce5c571a-c401-4633-b7cc-fcafc0e7661f req-d457cbad-d00f-42b1-9679-3f4fb2de00b0 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 943 time: 0.5045772
Jun 01 06:17:51.740171 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5994586-7118-44dd-8c7a-e519b2bc5f68 req-398c9603-b199-446c-8a6c-231b57eaf2f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:51.741660 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d5994586-7118-44dd-8c7a-e519b2bc5f68 req-398c9603-b199-446c-8a6c-231b57eaf2f8 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=c0ca2b878b874fe4af6e7b9fa8f6cf59&device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 1137 time: 0.4572229
Jun 01 06:17:51.759114 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] For port be4bfacb-b512-4361-b6c4-f38e7945c7aa, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=be4bfacb-b512-4361-b6c4-f38e7945c7aa,segment=NetworkSegment(5dda6d07-db2a-40a3-815e-42df1528c630),segment_id=5dda6d07-db2a-40a3-815e-42df1528c630)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:17:51.759465 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:51.789169 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-f97bea49-3280-476e-8c04-d0eedbbaa853 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756'] for port, after_delete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:51.794953 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-55b56c8b-270d-4c61-82c5-4ecc4d579b8a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:51.841746 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f97bea49-3280-476e-8c04-d0eedbbaa853 None None] Pushing event deleted for resources: {'Port': ['ID=be4bfacb-b512-4361-b6c4-f38e7945c7aa,revision_number=None']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:51.845146 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-f97bea49-3280-476e-8c04-d0eedbbaa853 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:51.846016 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f97bea49-3280-476e-8c04-d0eedbbaa853 None None] No DVR routers for this DVR port be4bfacb-b512-4361-b6c4-f38e7945c7aa on host dv-cinder-793885-1-iscsi {{(pid=92231) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:17:51.910043 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf2e032e-b0c5-455e-b236-f7abc534649f req-20a0f0e0-2ec4-4a06-9364-0055609ba8aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:51.911557 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-cf2e032e-b0c5-455e-b236-f7abc534649f req-20a0f0e0-2ec4-4a06-9364-0055609ba8aa service neutron] 10.222.0.48 "GET /v2.0/networks?id=5f973ed4-521b-4b78-9a54-1336b1302fa2 HTTP/1.1" status: 200  len: 917 time: 0.4260273
Jun 01 06:17:51.997529 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] Calling delete_port for be4bfacb-b512-4361-b6c4-f38e7945c7aa owned by network:dhcp {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:17:52.025212 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-cf2e032e-b0c5-455e-b236-f7abc534649f req-a5c638a8-5599-4696-8620-78fa7c2358de service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=3a7e88d5-0834-4e15-acbc-90cd1b9bca61 HTTP/1.1" status: 200  len: 997 time: 0.1064992
Jun 01 06:17:52.027830 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ce5c571a-c401-4633-b7cc-fcafc0e7661f req-5ff70820-af78-4cf8-bd64-404c2c497565 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.3673730
Jun 01 06:17:52.099364 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf2e032e-b0c5-455e-b236-f7abc534649f req-52718d62-0e0b-4cbf-a540-33f78de24c68 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:52.100905 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-cf2e032e-b0c5-455e-b236-f7abc534649f req-52718d62-0e0b-4cbf-a540-33f78de24c68 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=6137ee10-ce13-45c9-8edb-31811502bfd7 HTTP/1.1" status: 200  len: 855 time: 0.0676026
Jun 01 06:17:52.127316 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abf8fa5e-5b70-4ecf-95d3-6cddf0e92944 req-94ef44e3-6156-4b0d-b2af-ac9a59c0334f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:52.128701 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-abf8fa5e-5b70-4ecf-95d3-6cddf0e92944 req-94ef44e3-6156-4b0d-b2af-ac9a59c0334f service neutron] 10.222.0.48 "GET /v2.0/networks?id=028fef0a-f05a-48d5-ba5c-b539846209ba HTTP/1.1" status: 200  len: 912 time: 0.5239537
Jun 01 06:17:52.136601 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc07a772-8589-41ad-9d10-b4ec079b5755 req-f67df2d9-7d12-4afc-a109-c71c0cddb6c6 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:52.138160 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bc07a772-8589-41ad-9d10-b4ec079b5755 req-f67df2d9-7d12-4afc-a109-c71c0cddb6c6 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.5689020
Jun 01 06:17:52.142284 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5994586-7118-44dd-8c7a-e519b2bc5f68 req-7a6088f1-9fc3-4b26-a63c-0942678ce3ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:52.143692 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d5994586-7118-44dd-8c7a-e519b2bc5f68 req-7a6088f1-9fc3-4b26-a63c-0942678ce3ba service neutron] 10.222.0.48 "GET /v2.0/networks?id=d36c4486-6b2d-4439-996b-f13c04a98cb8 HTTP/1.1" status: 200  len: 916 time: 0.3705261
Jun 01 06:17:52.199346 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf2e032e-b0c5-455e-b236-f7abc534649f req-71d576b1-91ad-49da-84a4-bb337d4bf616 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:52.201317 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-cf2e032e-b0c5-455e-b236-f7abc534649f req-71d576b1-91ad-49da-84a4-bb337d4bf616 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=5f973ed4-521b-4b78-9a54-1336b1302fa2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0921597
Jun 01 06:17:52.214216 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 357a4df7-5d82-4e9d-b8d1-2190f63e3f9f no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:17:52.249474 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: 357a4df7-5d82-4e9d-b8d1-2190f63e3f9f {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:17:52.249988 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 357a4df7-5d82-4e9d-b8d1-2190f63e3f9f not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:17:52.250247 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device be4bfacb-b512-4361-b6c4-f38e7945c7aa no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:17:52.286629 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: be4bfacb-b512-4361-b6c4-f38e7945c7aa {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:17:52.287053 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device be4bfacb-b512-4361-b6c4-f38e7945c7aa not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:17:52.386084 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bc07a772-8589-41ad-9d10-b4ec079b5755 req-ede93671-c22b-4399-ab7e-17228c0dd9d4 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.1821897
Jun 01 06:17:52.387867 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-abf8fa5e-5b70-4ecf-95d3-6cddf0e92944 req-79f7ab9e-cfe6-4d39-9e84-2067336daae1 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=5ba208bf-2519-4a15-b4f5-8246cedadc63 HTTP/1.1" status: 200  len: 1001 time: 0.2471251
Jun 01 06:17:52.390541 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-cf2e032e-b0c5-455e-b236-f7abc534649f req-b32d6137-231f-422f-9d38-f7ecc4df8aab service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1825461
Jun 01 06:17:52.395574 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d5994586-7118-44dd-8c7a-e519b2bc5f68 req-3bad1c7f-a3c2-4463-9990-116684858dd1 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 HTTP/1.1" status: 200  len: 1001 time: 0.1982243
Jun 01 06:17:52.396650 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:52.402377 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-4adfe048-cf2b-4fb6-8b1d-ae83a3c4b24a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:52.520935 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] Pushing event deleted for resources: {'Port': ['ID=be4bfacb-b512-4361-b6c4-f38e7945c7aa,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:52.537731 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:52.542935 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] No DVR routers for this DVR port be4bfacb-b512-4361-b6c4-f38e7945c7aa on host dv-cinder-793885-1-iscsi {{(pid=92229) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:17:52.546064 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [req-cf2e032e-b0c5-455e-b236-f7abc534649f req-6ae78d5d-3c3f-4046-928d-efbceb2e8c09 service neutron] 10.222.0.48 "GET /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1411781
Jun 01 06:17:52.619199 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abf8fa5e-5b70-4ecf-95d3-6cddf0e92944 req-711e91fb-65b5-4203-8abf-d6c64485a0ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:52.621403 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-abf8fa5e-5b70-4ecf-95d3-6cddf0e92944 req-711e91fb-65b5-4203-8abf-d6c64485a0ee service neutron] 10.222.0.48 "GET /v2.0/subnets?id=cdffe000-7f35-495d-a741-b4c48a060887 HTTP/1.1" status: 200  len: 850 time: 0.2204425
Jun 01 06:17:52.820433 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5994586-7118-44dd-8c7a-e519b2bc5f68 req-027e9db1-b61f-40c8-b1fa-eccfc85b9e01 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:52.821860 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d5994586-7118-44dd-8c7a-e519b2bc5f68 req-027e9db1-b61f-40c8-b1fa-eccfc85b9e01 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=27e7a9e0-ab4e-478c-aff2-55a26159dc84 HTTP/1.1" status: 200  len: 854 time: 0.3865707
Jun 01 06:17:52.837787 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8093290', 'neutron.services.segments.db._delete_segments_for_network-8788497006300'] for network, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:52.896285 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe3b0d115e0>,) {'filters': {'network_id': ['0890ab9c-2266-4ef4-af73-d3ff421b9bd7']}} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:52.923988 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b0d115e0>, '5dda6d07-db2a-40a3-815e-42df1528c630') {'for_net_delete': True} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:52.924266 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b0d115e0>, '5dda6d07-db2a-40a3-815e-42df1528c630') {} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:52.946947 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8788497014941', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2127091'] for segment, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:52.971970 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:52.982626 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] Releasing vlan 224 on physical network physnet1 to pool {{(pid=92229) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 06:17:52.982941 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2077367'] for segment, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:   util.warn(
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:   util.warn(
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:   util.warn(
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:   util.warn(
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]: Traceback (most recent call last):
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:     timer()
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:     cb(*args, **kw)
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:     return func(*args, **kwargs)
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:     self._notify()
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:     self.callback(batched_events)
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:     event.method(event)
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:     return f(self, *a, **k)
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self._get(url).json()
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self.request(url, 'GET', **kwargs)
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 06:17:52.997389 dv-cinder-793885-1-iscsi neutron-server[92229]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 06:17:53.008783 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abf8fa5e-5b70-4ecf-95d3-6cddf0e92944 req-40fb89c7-d5d6-4c82-9d08-69d8bce5c680 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:53.010826 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-abf8fa5e-5b70-4ecf-95d3-6cddf0e92944 req-40fb89c7-d5d6-4c82-9d08-69d8bce5c680 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=028fef0a-f05a-48d5-ba5c-b539846209ba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2238519
Jun 01 06:17:53.091882 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5994586-7118-44dd-8c7a-e519b2bc5f68 req-29810a1d-1789-4327-9b45-015516ede6ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:53.093360 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d5994586-7118-44dd-8c7a-e519b2bc5f68 req-29810a1d-1789-4327-9b45-015516ede6ea service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=d36c4486-6b2d-4439-996b-f13c04a98cb8&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2582085
Jun 01 06:17:53.288114 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8093283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-745674'] for network, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:53.305374 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:53.326788 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:53.368631 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] Pushing event deleted for resources: {'Network': ['ID=0890ab9c-2266-4ef4-af73-d3ff421b9bd7,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:53.384885 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:53.427731 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d5994586-7118-44dd-8c7a-e519b2bc5f68 req-270dfedf-b1bd-4048-ab2c-208f48ba4a5c service neutron] 10.222.0.48 "GET /v2.0/networks/d36c4486-6b2d-4439-996b-f13c04a98cb8?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3241715
Jun 01 06:17:53.430762 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-abf8fa5e-5b70-4ecf-95d3-6cddf0e92944 req-ca61a8d7-adcc-41c2-b40d-9ac1999e1479 service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3723402
Jun 01 06:17:53.436661 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] 10.222.0.25 "DELETE /v2.0/networks/0890ab9c-2266-4ef4-af73-d3ff421b9bd7 HTTP/1.1" status: 204  len: 168 time: 2.5017323
Jun 01 06:17:53.565558 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39218) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:53.618465 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-923a9641-4c92-4789-aed1-c2b19e52f5ee admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=ac4006667c3442a3910d548e9e9d22c0&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0494630
Jun 01 06:17:53.618724 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39222) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:53.663628 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6083dc43-7a52-4acb-b53b-94eb5403e4b1 req-90e966e3-d35f-4609-ba42-674fb1aec045 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:53.665169 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6083dc43-7a52-4acb-b53b-94eb5403e4b1 req-90e966e3-d35f-4609-ba42-674fb1aec045 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 943 time: 0.4892497
Jun 01 06:17:53.681752 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9d150b01-df13-424f-82c3-2ad9b4d2a495 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:53.711125 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9d150b01-df13-424f-82c3-2ad9b4d2a495 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:53.785225 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9d150b01-df13-424f-82c3-2ad9b4d2a495 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:53.791371 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-fcc051ee-cc52-42f7-be1c-353400152264 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:53.810763 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6083dc43-7a52-4acb-b53b-94eb5403e4b1 req-019bf68a-37d4-42ce-ad50-047bad125c01 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1306868
Jun 01 06:17:53.811644 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d150b01-df13-424f-82c3-2ad9b4d2a495 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2fb048dd-4226-46c8-832f-1144e8263e05,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:53.815027 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-abf8fa5e-5b70-4ecf-95d3-6cddf0e92944 req-fb17f3ca-a7ed-428f-9ea4-03f0c0dcf5eb service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3696647
Jun 01 06:17:53.817176 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d5994586-7118-44dd-8c7a-e519b2bc5f68 req-fa7171a0-9a53-463b-8a00-3e79482bd704 service neutron] 10.222.0.48 "GET /v2.0/networks/d36c4486-6b2d-4439-996b-f13c04a98cb8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3706474
Jun 01 06:17:53.819471 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-9d150b01-df13-424f-82c3-2ad9b4d2a495 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:53.836993 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9d150b01-df13-424f-82c3-2ad9b4d2a495 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:53.839300 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-9d150b01-df13-424f-82c3-2ad9b4d2a495 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/2fb048dd-4226-46c8-832f-1144e8263e05 HTTP/1.1" status: 204  len: 168 time: 0.2195258
Jun 01 06:17:53.848992 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84e8bb23-dd21-4858-b6ed-595a6e83c4d3 req-238dac3d-4975-43c4-9e2a-59fb262739aa tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:53.850297 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-84e8bb23-dd21-4858-b6ed-595a6e83c4d3 req-238dac3d-4975-43c4-9e2a-59fb262739aa tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.3022311
Jun 01 06:17:53.911705 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-84e8bb23-dd21-4858-b6ed-595a6e83c4d3 req-1f330797-d31c-47b4-ba8b-ae83e195e9e1 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0537915
Jun 01 06:17:54.651753 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39246) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:54.755806 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1541116284-network', 'tenant_id': '712ccff2244a4cd595aab30f4619d0bb'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:17:54.760591 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:17:54.764417 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Usage tracker for resource:network and tenant:712ccff2244a4cd595aab30f4619d0bb is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:17:54.767232 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:17:54.772819 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:17:54.783584 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Made reservation on behalf of 712ccff2244a4cd595aab30f4619d0bb for: {'network': 1} {{(pid=92230) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:17:54.785837 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-8110114'] for network, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:54.798282 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:54.813207 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:17:54.817188 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Usage tracker for resource:security_group_rule and tenant:712ccff2244a4cd595aab30f4619d0bb is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:17:54.819999 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:17:54.821801 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:17:54.826442 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:17:54.916620 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:54.920716 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:54.925062 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-9d150b01-df13-424f-82c3-2ad9b4d2a495 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:54.962671 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=3a7e88d5-0834-4e15-acbc-90cd1b9bca61,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:17:54.964034 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] vlan segment allocate from pool success with {'vlan_id': 239, 'physical_network': 'physnet1'}  {{(pid=92230) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 06:17:54.973420 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0765f9d4-2146-4dbc-9893-4fb997e93515,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:54.976696 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:54.978599 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'port_id': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61', 'mac_address': 'fa:16:3e:84:9b:48', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 245, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:17:54.981654 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:54.981999 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.db.segments_db [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Added segment 92c37f9e-07e1-4a67-bceb-60e7dd3542b2 of type vlan for network e545fd6c-9962-4833-86ec-2dd273944d4c
Jun 01 06:17:55.019365 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8788496565589'] for network, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:55.042958 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:55.055425 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104'] for network, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:55.056938 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:55.058056 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:55.062937 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:55.063716 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:17:55.082746 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=3a7e88d5-0834-4e15-acbc-90cd1b9bca61,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:17:55.087457 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:55.090637 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-a9f25f3e-a1ff-4764-9a44-b4d41bbeb628 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:55.149304 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9837457b-61c1-4c7e-8f91-2735ef2e7cd7 req-c20fbdda-fa17-4d10-b09b-dcd5a9b3bc75 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:55.150760 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9837457b-61c1-4c7e-8f91-2735ef2e7cd7 req-c20fbdda-fa17-4d10-b09b-dcd5a9b3bc75 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 943 time: 0.1596024
Jun 01 06:17:55.168269 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f8d7de6-6523-4966-911e-7107add5cd38 req-2454ac2e-08ec-4448-836e-a94f84503baa tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:55.169477 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 898 time: 0.5166187
Jun 01 06:17:55.169803 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1f8d7de6-6523-4966-911e-7107add5cd38 req-2454ac2e-08ec-4448-836e-a94f84503baa tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.1120484
Jun 01 06:17:55.170396 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Pushing event updated for resources: {'Network': ['ID=e545fd6c-9962-4833-86ec-2dd273944d4c,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:55.172373 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39256) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:55.175099 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:55.178994 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-9566b34b-1b98-40a3-9825-bc57a74c6ed6 admin admin] Request body: {'subnet': {'network_id': 'e545fd6c-9962-4833-86ec-2dd273944d4c', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1541116284-subnet', 'tenant_id': '712ccff2244a4cd595aab30f4619d0bb', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:17:55.184978 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-9566b34b-1b98-40a3-9825-bc57a74c6ed6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:17:55.186264 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Network e545fd6c-9962-4833-86ec-2dd273944d4c details requested by agent ovs-agent-dv-cinder-793885-1-iscsi with host dv-cinder-793885-1-iscsi {{(pid=92231) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 06:17:55.189962 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-9566b34b-1b98-40a3-9825-bc57a74c6ed6 admin admin] Usage tracker for resource:subnet and tenant:712ccff2244a4cd595aab30f4619d0bb is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:17:55.193251 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-9566b34b-1b98-40a3-9825-bc57a74c6ed6 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:17:55.199932 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-9566b34b-1b98-40a3-9825-bc57a74c6ed6 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:17:55.213026 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9566b34b-1b98-40a3-9825-bc57a74c6ed6 admin admin] Made reservation on behalf of 712ccff2244a4cd595aab30f4619d0bb for: {'subnet': 1} {{(pid=92230) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:17:55.216254 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9566b34b-1b98-40a3-9825-bc57a74c6ed6 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1981512'] for subnet, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:55.250233 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9837457b-61c1-4c7e-8f91-2735ef2e7cd7 req-7efdf482-9995-4568-995d-8762c4276d61 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0918109
Jun 01 06:17:55.257235 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1f8d7de6-6523-4966-911e-7107add5cd38 req-936e1b63-fea1-430b-98a4-cb578cc3b47a tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0681896
Jun 01 06:17:55.281793 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=3a7e88d5-0834-4e15-acbc-90cd1b9bca61,revision_number=9']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:55.292807 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:55.357152 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['3a7e88d5-0834-4e15-acbc-90cd1b9bca61'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:17:55.639041 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9566b34b-1b98-40a3-9825-bc57a74c6ed6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2445565', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1981534'] for subnet, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:55.643013 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-eb7875e6-732f-4fcd-b4c3-e13a466637fd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:55.714888 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9566b34b-1b98-40a3-9825-bc57a74c6ed6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=95892591-8ea9-4214-af70-460fdca6a011,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:55.718287 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-9566b34b-1b98-40a3-9825-bc57a74c6ed6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:55.724185 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9566b34b-1b98-40a3-9825-bc57a74c6ed6 admin admin] Checking segment: {'id': '92c37f9e-07e1-4a67-bceb-60e7dd3542b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 239, 'network_id': 'e545fd6c-9962-4833-86ec-2dd273944d4c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92230) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:17:55.724532 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9566b34b-1b98-40a3-9825-bc57a74c6ed6 admin admin] Network hostable DHCP agents. Network: e545fd6c-9962-4833-86ec-2dd273944d4c, hostable agents: ['648832f0-f26e-4e29-ac0d-d97e4a75c6c4'], hosted agents: [] {{(pid=92230) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 06:17:55.749119 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9566b34b-1b98-40a3-9825-bc57a74c6ed6 admin admin] Network e545fd6c-9962-4833-86ec-2dd273944d4c is scheduled to be hosted by DHCP agent 648832f0-f26e-4e29-ac0d-d97e4a75c6c4 with binding_index 1 {{(pid=92230) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 06:17:55.766042 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-9566b34b-1b98-40a3-9825-bc57a74c6ed6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793885-1-iscsi, e545fd6c-9962-4833-86ec-2dd273944d4c) {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:17:55.775184 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9566b34b-1b98-40a3-9825-bc57a74c6ed6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:55.775704 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9566b34b-1b98-40a3-9825-bc57a74c6ed6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:55.779267 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc49f052-be1f-431d-90b0-fd1ad93a028c None None] Network e545fd6c-9962-4833-86ec-2dd273944d4c requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:17:55.810069 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-9566b34b-1b98-40a3-9825-bc57a74c6ed6 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 862 time: 0.6273792
Jun 01 06:17:55.999028 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3a8b8eb0-faa0-4c32-848e-094181878a27 None None] Network e545fd6c-9962-4833-86ec-2dd273944d4c requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:17:56.364872 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39278) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:56.373972 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1998008285-network', 'tenant_id': '5c2352a31edc40a9846e024bb4444964'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:17:56.379354 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:17:56.384068 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Usage tracker for resource:network and tenant:5c2352a31edc40a9846e024bb4444964 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:17:56.388132 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:17:56.394218 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:17:56.410070 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Made reservation on behalf of 5c2352a31edc40a9846e024bb4444964 for: {'network': 1} {{(pid=92230) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:17:56.412557 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-8110114'] for network, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:56.426188 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:56.442661 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:17:56.447262 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Usage tracker for resource:security_group_rule and tenant:5c2352a31edc40a9846e024bb4444964 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:17:56.450312 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:17:56.456226 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:17:56.535727 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea239e7b-e3b1-40d7-8939-69f260dbf64c req-ca54fe2d-7976-475f-bfe0-b245a95429f7 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:56.537411 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ea239e7b-e3b1-40d7-8939-69f260dbf64c req-ca54fe2d-7976-475f-bfe0-b245a95429f7 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.1195440
Jun 01 06:17:56.546708 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7524cae-72db-49bd-a50d-e169328ec167 req-87b8cb06-e4da-4ad3-bf27-ff8c4104fb8c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:56.548243 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e7524cae-72db-49bd-a50d-e169328ec167 req-87b8cb06-e4da-4ad3-bf27-ff8c4104fb8c tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 944 time: 0.1639473
Jun 01 06:17:56.549194 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:56.558572 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:56.562054 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-b6e577be-92a7-4a8a-9a8c-8fc24a37a29a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:56.583504 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] vlan segment allocate from pool success with {'vlan_id': 228, 'physical_network': 'physnet1'}  {{(pid=92230) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 06:17:56.606400 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:56.606747 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.db.segments_db [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Added segment e54fda78-035e-4ea5-936d-ef77571e67b7 of type vlan for network 8c4968de-559b-4889-abf7-14293b66db56
Jun 01 06:17:56.607957 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e30d624f-1562-4e36-947a-53697951ef11,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:56.614565 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:56.628820 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ea239e7b-e3b1-40d7-8939-69f260dbf64c req-52c168db-10e4-4505-898e-cd145b5cc6d6 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0795498
Jun 01 06:17:56.633881 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e7524cae-72db-49bd-a50d-e169328ec167 req-6354ef10-00cb-47fd-bcbb-00faecd1c428 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0690222
Jun 01 06:17:56.640987 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8788496565589'] for network, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:56.673958 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104'] for network, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:56.675260 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:56.675897 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:56.679338 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-5f65cd81-26c4-4eea-8daf-f2af415af49f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:56.852659 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:17:56.872021 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 898 time: 0.5052159
Jun 01 06:17:56.873001 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Pushing event updated for resources: {'Network': ['ID=8c4968de-559b-4889-abf7-14293b66db56,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:56.874985 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39282) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:56.877414 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:56.881307 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-b2eb2696-8e72-48f8-8328-3e8ca51289a2 admin admin] Request body: {'subnet': {'network_id': '8c4968de-559b-4889-abf7-14293b66db56', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1998008285-subnet', 'tenant_id': '5c2352a31edc40a9846e024bb4444964', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:17:56.886938 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-b2eb2696-8e72-48f8-8328-3e8ca51289a2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:17:56.890854 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-b2eb2696-8e72-48f8-8328-3e8ca51289a2 admin admin] Usage tracker for resource:subnet and tenant:5c2352a31edc40a9846e024bb4444964 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:17:56.893181 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Network 8c4968de-559b-4889-abf7-14293b66db56 details requested by agent ovs-agent-dv-cinder-793885-1-iscsi with host dv-cinder-793885-1-iscsi {{(pid=92231) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 06:17:56.893772 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-b2eb2696-8e72-48f8-8328-3e8ca51289a2 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:17:56.900074 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-b2eb2696-8e72-48f8-8328-3e8ca51289a2 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:17:56.913335 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b2eb2696-8e72-48f8-8328-3e8ca51289a2 admin admin] Made reservation on behalf of 5c2352a31edc40a9846e024bb4444964 for: {'subnet': 1} {{(pid=92230) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:17:56.915704 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b2eb2696-8e72-48f8-8328-3e8ca51289a2 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1981512'] for subnet, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:57.019056 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:17:57.019607 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:57.146820 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:57.174648 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0504a6b7-2f41-4914-a3bb-2f908556d658', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:17:57.177012 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-20f8f8fa-e731-4288-83de-49fefb6af028" -d '{"events": [{"server_uuid": "0504a6b7-2f41-4914-a3bb-2f908556d658", "name": "network-vif-plugged", "status": "completed", "tag": "3a7e88d5-0834-4e15-acbc-90cd1b9bca61"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:17:57.187102 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=3a7e88d5-0834-4e15-acbc-90cd1b9bca61,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:17:57.194041 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:57.196680 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:57.235373 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:17:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-96970f14-dbe5-46a8-a3b3-e9e05402810b x-openstack-request-id: req-96970f14-dbe5-46a8-a3b3-e9e05402810b {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:17:57.235671 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0504a6b7-2f41-4914-a3bb-2f908556d658", "name": "network-vif-plugged", "status": "completed", "tag": "3a7e88d5-0834-4e15-acbc-90cd1b9bca61", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:17:57.235956 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-96970f14-dbe5-46a8-a3b3-e9e05402810b {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:17:57.236357 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0504a6b7-2f41-4914-a3bb-2f908556d658', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61', 'code': 200}
Jun 01 06:17:57.271207 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=3a7e88d5-0834-4e15-acbc-90cd1b9bca61,revision_number=10']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:57.275525 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:57.354265 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b2eb2696-8e72-48f8-8328-3e8ca51289a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2445565', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1981534'] for subnet, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:57.358747 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-01d68eb7-0531-4dce-89b7-0877788982c3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:57.432846 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2eb2696-8e72-48f8-8328-3e8ca51289a2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=aa4547e9-e0ef-491c-996a-3ce8d503683e,revision_number=0']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:57.450679 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-b2eb2696-8e72-48f8-8328-3e8ca51289a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:57.458490 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2eb2696-8e72-48f8-8328-3e8ca51289a2 admin admin] Checking segment: {'id': 'e54fda78-035e-4ea5-936d-ef77571e67b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 228, 'network_id': '8c4968de-559b-4889-abf7-14293b66db56'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92230) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:17:57.458982 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2eb2696-8e72-48f8-8328-3e8ca51289a2 admin admin] Network hostable DHCP agents. Network: 8c4968de-559b-4889-abf7-14293b66db56, hostable agents: ['648832f0-f26e-4e29-ac0d-d97e4a75c6c4'], hosted agents: [] {{(pid=92230) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 06:17:57.478160 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2eb2696-8e72-48f8-8328-3e8ca51289a2 admin admin] Network 8c4968de-559b-4889-abf7-14293b66db56 is scheduled to be hosted by DHCP agent 648832f0-f26e-4e29-ac0d-d97e4a75c6c4 with binding_index 1 {{(pid=92230) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 06:17:57.489699 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-b2eb2696-8e72-48f8-8328-3e8ca51289a2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793885-1-iscsi, 8c4968de-559b-4889-abf7-14293b66db56) {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:17:57.499442 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2eb2696-8e72-48f8-8328-3e8ca51289a2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:57.500085 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b2eb2696-8e72-48f8-8328-3e8ca51289a2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:57.501447 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c05a4a07-e98e-4d56-af23-3251bf92047a None None] Network 8c4968de-559b-4889-abf7-14293b66db56 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:17:57.528485 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-b2eb2696-8e72-48f8-8328-3e8ca51289a2 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 862 time: 0.6524456
Jun 01 06:17:57.627736 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9be7ca0d-5c24-44c9-a6b3-70b46a28ba78 req-6fd80091-1d80-4035-af79-378a29dc3bd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:57.629269 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9be7ca0d-5c24-44c9-a6b3-70b46a28ba78 req-6fd80091-1d80-4035-af79-378a29dc3bd9 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 1099 time: 0.2112584
Jun 01 06:17:57.677038 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9be7ca0d-5c24-44c9-a6b3-70b46a28ba78 req-cd43a6a0-678a-4fe0-b638-6e90f322f993 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0395896
Jun 01 06:17:57.696656 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 39294) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:57.725340 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-725ac7a9-e15f-46ab-8550-6c9391920585 None None] Network 8c4968de-559b-4889-abf7-14293b66db56 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:17:57.777575 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_v2 [None req-d8763359-6b1a-4f86-83d9-c57e8dabb452 admin admin] Deleting subnet 95892591-8ea9-4214-af70-460fdca6a011 {{(pid=92229) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 06:17:57.813254 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d8763359-6b1a-4f86-83d9-c57e8dabb452 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:57.942253 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d8763359-6b1a-4f86-83d9-c57e8dabb452 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2127096'] for subnet, precommit_delete_associations {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:58.018983 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d8763359-6b1a-4f86-83d9-c57e8dabb452 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8086245'] for subnet, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:58.062019 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-910c58d0-bf4b-43c0-90b5-c7588d0bb6e1 req-f1bf2bfa-310c-4d51-8ffa-dd5be6d0d6f8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:58.063470 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-910c58d0-bf4b-43c0-90b5-c7588d0bb6e1 req-f1bf2bfa-310c-4d51-8ffa-dd5be6d0d6f8 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 946 time: 0.2834890
Jun 01 06:17:58.097464 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca42209d-339a-409e-9afe-2782aa301c71 req-81d82504-5bb6-4d88-8fda-76a975f6fdaa tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:58.098917 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ca42209d-339a-409e-9afe-2782aa301c71 req-81d82504-5bb6-4d88-8fda-76a975f6fdaa tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.2510448
Jun 01 06:17:58.228337 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-910c58d0-bf4b-43c0-90b5-c7588d0bb6e1 req-d3095f6b-f294-4f06-8616-4a34c70cd8f3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1557136
Jun 01 06:17:58.250679 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ca42209d-339a-409e-9afe-2782aa301c71 req-536a3303-4ffe-4970-a3f1-f469870f0165 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.1426604
Jun 01 06:17:58.372201 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d8763359-6b1a-4f86-83d9-c57e8dabb452 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8087120', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1981457', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2134750'] for subnet, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:58.376591 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-248453de-58a7-4e37-9337-ce756fd0a73f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:58.416998 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8763359-6b1a-4f86-83d9-c57e8dabb452 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=95892591-8ea9-4214-af70-460fdca6a011,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:58.420139 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-d8763359-6b1a-4f86-83d9-c57e8dabb452 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:58.421195 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d8763359-6b1a-4f86-83d9-c57e8dabb452 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:58.431400 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39298) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:58.432819 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-d8763359-6b1a-4f86-83d9-c57e8dabb452 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/95892591-8ea9-4214-af70-460fdca6a011 HTTP/1.1" status: 204  len: 168 time: 0.7339909
Jun 01 06:17:58.566123 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-78cefa49-f8b8-4fe0-892c-e41ac130ee89 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8063377'] for network, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:58.717286 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-78cefa49-f8b8-4fe0-892c-e41ac130ee89 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8093290', 'neutron.services.segments.db._delete_segments_for_network-8788497006300'] for network, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:58.733561 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-78cefa49-f8b8-4fe0-892c-e41ac130ee89 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe3b31249a0>,) {'filters': {'network_id': ['e545fd6c-9962-4833-86ec-2dd273944d4c']}} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:58.748217 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-78cefa49-f8b8-4fe0-892c-e41ac130ee89 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b31249a0>, '92c37f9e-07e1-4a67-bceb-60e7dd3542b2') {'for_net_delete': True} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:58.748506 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-78cefa49-f8b8-4fe0-892c-e41ac130ee89 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b31249a0>, '92c37f9e-07e1-4a67-bceb-60e7dd3542b2') {} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:58.762004 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-78cefa49-f8b8-4fe0-892c-e41ac130ee89 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8788497014941', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2178892'] for segment, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:58.784717 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-78cefa49-f8b8-4fe0-892c-e41ac130ee89 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:58.792243 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-78cefa49-f8b8-4fe0-892c-e41ac130ee89 admin admin] Releasing vlan 239 on physical network physnet1 to pool {{(pid=92230) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 06:17:58.792630 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-78cefa49-f8b8-4fe0-892c-e41ac130ee89 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2416152'] for segment, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]: Traceback (most recent call last):
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:     timer()
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:     cb(*args, **kw)
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:     return func(*args, **kwargs)
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:     self._notify()
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:     self.callback(batched_events)
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:     event.method(event)
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:     return f(self, *a, **k)
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self._get(url).json()
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self.request(url, 'GET', **kwargs)
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 06:17:58.806527 dv-cinder-793885-1-iscsi neutron-server[92230]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 06:17:58.888234 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-78cefa49-f8b8-4fe0-892c-e41ac130ee89 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8093283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-745674'] for network, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:58.893959 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-78cefa49-f8b8-4fe0-892c-e41ac130ee89 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:58.897697 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:58.918879 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-78cefa49-f8b8-4fe0-892c-e41ac130ee89 admin admin] 10.222.0.25 "DELETE /v2.0/networks/e545fd6c-9962-4833-86ec-2dd273944d4c HTTP/1.1" status: 204  len: 168 time: 0.4836197
Jun 01 06:17:58.922205 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78cefa49-f8b8-4fe0-892c-e41ac130ee89 admin admin] Pushing event deleted for resources: {'Network': ['ID=e545fd6c-9962-4833-86ec-2dd273944d4c,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:58.922862 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 39324) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:58.924675 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-78cefa49-f8b8-4fe0-892c-e41ac130ee89 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:58.995877 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_v2 [None req-a17c66e4-7ddc-4a7a-8d1d-ca95f60a1b42 admin admin] Deleting subnet aa4547e9-e0ef-491c-996a-3ce8d503683e {{(pid=92229) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 06:17:59.000017 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-a17c66e4-7ddc-4a7a-8d1d-ca95f60a1b42 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:59.065149 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-a17c66e4-7ddc-4a7a-8d1d-ca95f60a1b42 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2127096'] for subnet, precommit_delete_associations {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:59.133816 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-a17c66e4-7ddc-4a7a-8d1d-ca95f60a1b42 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8086245'] for subnet, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:59.549052 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-a17c66e4-7ddc-4a7a-8d1d-ca95f60a1b42 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8087120', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1981457', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2134750'] for subnet, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:59.559766 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-dc8a385a-9121-4bce-a9ca-5c0f5ef5c9b4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:17:59.606964 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a17c66e4-7ddc-4a7a-8d1d-ca95f60a1b42 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=aa4547e9-e0ef-491c-996a-3ce8d503683e,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:17:59.614301 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-a17c66e4-7ddc-4a7a-8d1d-ca95f60a1b42 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:17:59.618575 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-a17c66e4-7ddc-4a7a-8d1d-ca95f60a1b42 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:59.635069 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27b1fc38-0175-454d-949c-27efe5b1c601 req-6eeec1f8-ea49-4d13-be34-44063ade6371 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:59.636813 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-27b1fc38-0175-454d-949c-27efe5b1c601 req-6eeec1f8-ea49-4d13-be34-44063ade6371 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.2460356
Jun 01 06:17:59.639379 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-a17c66e4-7ddc-4a7a-8d1d-ca95f60a1b42 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/aa4547e9-e0ef-491c-996a-3ce8d503683e HTTP/1.1" status: 204  len: 168 time: 0.7153170
Jun 01 06:17:59.642190 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39346) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:17:59.647427 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c610f210-3aa9-470c-bd3b-8c44b5bc411d req-af50bf5c-4a85-4a84-a040-9888c374ac74 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:17:59.648970 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c610f210-3aa9-470c-bd3b-8c44b5bc411d req-af50bf5c-4a85-4a84-a040-9888c374ac74 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 946 time: 0.2519302
Jun 01 06:17:59.725461 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-27b1fc38-0175-454d-949c-27efe5b1c601 req-ff4ea360-c06a-4955-98f4-0b205881d729 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0754361
Jun 01 06:17:59.735401 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c610f210-3aa9-470c-bd3b-8c44b5bc411d req-102d938a-037c-4ff4-9e9d-efd242300dde tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0674684
Jun 01 06:17:59.783224 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-08f764d3-0c23-4ad2-8048-face5e78f8a3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8063377'] for network, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:59.922967 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-08f764d3-0c23-4ad2-8048-face5e78f8a3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8093290', 'neutron.services.segments.db._delete_segments_for_network-8788497006300'] for network, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:59.938732 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-08f764d3-0c23-4ad2-8048-face5e78f8a3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe3b26b5130>,) {'filters': {'network_id': ['8c4968de-559b-4889-abf7-14293b66db56']}} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:59.952480 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-08f764d3-0c23-4ad2-8048-face5e78f8a3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b26b5130>, 'e54fda78-035e-4ea5-936d-ef77571e67b7') {'for_net_delete': True} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:59.952767 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-08f764d3-0c23-4ad2-8048-face5e78f8a3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b26b5130>, 'e54fda78-035e-4ea5-936d-ef77571e67b7') {} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:17:59.964658 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-08f764d3-0c23-4ad2-8048-face5e78f8a3 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8788497014941', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2178892'] for segment, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:59.984740 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-08f764d3-0c23-4ad2-8048-face5e78f8a3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:17:59.991356 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-08f764d3-0c23-4ad2-8048-face5e78f8a3 admin admin] Releasing vlan 228 on physical network physnet1 to pool {{(pid=92230) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 06:17:59.992828 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-08f764d3-0c23-4ad2-8048-face5e78f8a3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2416152'] for segment, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]: Traceback (most recent call last):
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:     timer()
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:     cb(*args, **kw)
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:     return func(*args, **kwargs)
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:     self._notify()
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:     self.callback(batched_events)
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:     event.method(event)
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:     return f(self, *a, **k)
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self._get(url).json()
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self.request(url, 'GET', **kwargs)
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 06:18:00.006603 dv-cinder-793885-1-iscsi neutron-server[92230]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 06:18:00.084985 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-08f764d3-0c23-4ad2-8048-face5e78f8a3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8093283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-745674'] for network, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:00.089390 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:00.102409 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-08f764d3-0c23-4ad2-8048-face5e78f8a3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:00.112501 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08f764d3-0c23-4ad2-8048-face5e78f8a3 admin admin] Pushing event deleted for resources: {'Network': ['ID=8c4968de-559b-4889-abf7-14293b66db56,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:00.114913 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-08f764d3-0c23-4ad2-8048-face5e78f8a3 admin admin] 10.222.0.25 "DELETE /v2.0/networks/8c4968de-559b-4889-abf7-14293b66db56 HTTP/1.1" status: 204  len: 168 time: 0.4662912
Jun 01 06:18:00.115834 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-08f764d3-0c23-4ad2-8048-face5e78f8a3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:00.295475 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39352) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:00.349630 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-a15f82f6-f67d-44c1-8e16-2da76efea796 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=712ccff2244a4cd595aab30f4619d0bb&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0528033
Jun 01 06:18:00.352336 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39356) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:00.411651 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8761f761-9fd8-4560-b83c-1fd665e6ab0c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:00.439466 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8761f761-9fd8-4560-b83c-1fd665e6ab0c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:00.508585 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8761f761-9fd8-4560-b83c-1fd665e6ab0c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:00.516989 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-3283840d-31f1-4f6b-91bb-3b5e5f053f18 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:00.530371 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8761f761-9fd8-4560-b83c-1fd665e6ab0c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0765f9d4-2146-4dbc-9893-4fb997e93515,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:00.532819 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-8761f761-9fd8-4560-b83c-1fd665e6ab0c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:00.539242 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8761f761-9fd8-4560-b83c-1fd665e6ab0c admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:00.544157 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-8761f761-9fd8-4560-b83c-1fd665e6ab0c admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/0765f9d4-2146-4dbc-9893-4fb997e93515 HTTP/1.1" status: 204  len: 168 time: 0.1871910
Jun 01 06:18:00.918024 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39368) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:00.984992 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-a5f3d9ec-f3de-4950-99da-98de4d90fc44 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=5c2352a31edc40a9846e024bb4444964&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0645583
Jun 01 06:18:00.987267 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39372) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:00.990461 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a372b3-74a7-43ef-9c0f-b35adea9f693 req-0c9f5d53-6cd9-4621-b91c-820697d43b12 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:00.991950 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-85a372b3-74a7-43ef-9c0f-b35adea9f693 req-0c9f5d53-6cd9-4621-b91c-820697d43b12 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 946 time: 0.1140726
Jun 01 06:18:00.999905 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-671462e1-3224-41fa-89be-770f06333a40 req-14f79a7d-83c3-4c35-853e-cb050aea3b4c tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:01.001404 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-671462e1-3224-41fa-89be-770f06333a40 req-14f79a7d-83c3-4c35-853e-cb050aea3b4c tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.1613407
Jun 01 06:18:01.056340 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f46aeb32-ad16-43cf-9fe5-1dbed299f4cd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:01.078015 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-85a372b3-74a7-43ef-9c0f-b35adea9f693 req-05627d3c-adf1-4cc2-8bf8-31aff665d64b tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0756068
Jun 01 06:18:01.084956 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-671462e1-3224-41fa-89be-770f06333a40 req-b533ed66-b562-42af-903e-f7b24a67d3ca tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0687490
Jun 01 06:18:01.087440 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f46aeb32-ad16-43cf-9fe5-1dbed299f4cd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:01.150248 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f46aeb32-ad16-43cf-9fe5-1dbed299f4cd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:01.154935 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-105ad34a-927e-4ec7-9316-6363246dc306 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:01.166045 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f46aeb32-ad16-43cf-9fe5-1dbed299f4cd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e30d624f-1562-4e36-947a-53697951ef11,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:01.169939 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-f46aeb32-ad16-43cf-9fe5-1dbed299f4cd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:01.173368 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f46aeb32-ad16-43cf-9fe5-1dbed299f4cd admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:01.174460 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-f46aeb32-ad16-43cf-9fe5-1dbed299f4cd admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/e30d624f-1562-4e36-947a-53697951ef11 HTTP/1.1" status: 204  len: 168 time: 0.1860971
Jun 01 06:18:02.379263 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8163375c-8bb9-44a6-b95a-ed0034642d44 req-bcd938a3-6ab8-4c0a-babd-d5df865bfeee tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:02.380723 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8163375c-8bb9-44a6-b95a-ed0034642d44 req-bcd938a3-6ab8-4c0a-babd-d5df865bfeee tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.1862502
Jun 01 06:18:02.430343 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8163375c-8bb9-44a6-b95a-ed0034642d44 req-01d8cd1b-4f78-4124-91b2-84f1ecb8784d tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0434937
Jun 01 06:18:03.633936 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10fb58d6-ce5a-4037-9744-daa69cbe4053 req-0a1ca62d-986d-46b6-af74-ecacd3ee4376 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:03.636027 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-10fb58d6-ce5a-4037-9744-daa69cbe4053 req-0a1ca62d-986d-46b6-af74-ecacd3ee4376 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.0857623
Jun 01 06:18:03.686306 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-10fb58d6-ce5a-4037-9744-daa69cbe4053 req-2dc626cb-f54f-41ae-af56-849d0508b286 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0443649
Jun 01 06:18:04.883085 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-825268db-b0ef-426e-9b0a-8a5be4505f2e req-e9c82479-3efc-47ba-986f-78398f9ba780 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:04.884666 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-825268db-b0ef-426e-9b0a-8a5be4505f2e req-e9c82479-3efc-47ba-986f-78398f9ba780 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.0851126
Jun 01 06:18:04.957669 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-825268db-b0ef-426e-9b0a-8a5be4505f2e req-61ced6fc-6cc4-4571-8304-6f11e4f295a4 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0657635
Jun 01 06:18:06.168440 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2d8495f-d656-4e1c-b268-c5d43e515502 req-171ea4fe-2a33-4598-ae38-f3a66cf69475 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:06.170052 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a2d8495f-d656-4e1c-b268-c5d43e515502 req-171ea4fe-2a33-4598-ae38-f3a66cf69475 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.0980701
Jun 01 06:18:06.225315 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a2d8495f-d656-4e1c-b268-c5d43e515502 req-2f03c053-5658-4c7b-8c4b-07f225d59e3b tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0487821
Jun 01 06:18:07.452599 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e41049c4-2120-402e-9915-abe41085d672 req-bd8fba40-007d-41d4-b3a0-5ce2e446d76d tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:07.454140 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e41049c4-2120-402e-9915-abe41085d672 req-bd8fba40-007d-41d4-b3a0-5ce2e446d76d tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.1036589
Jun 01 06:18:07.507504 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e41049c4-2120-402e-9915-abe41085d672 req-d7c4349f-2b06-4277-adf2-25ed2ed19be3 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0469730
Jun 01 06:18:08.339925 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-78e1e259-3124-4d43-a290-9db94b8b242a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:08.724495 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68680471-e4ff-428b-a51d-15b5b2699a29 req-2563f060-2f53-4ea6-b42e-398d7369362d tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:08.726119 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-68680471-e4ff-428b-a51d-15b5b2699a29 req-2563f060-2f53-4ea6-b42e-398d7369362d tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.0884974
Jun 01 06:18:08.780004 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-68680471-e4ff-428b-a51d-15b5b2699a29 req-2d529f81-046a-4e52-aba4-a2701d495f85 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0468225
Jun 01 06:18:09.993819 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33eb55df-901c-44bb-bcb0-495cdaf28e09 req-1d23374b-4d5f-4896-a71b-f6ad013208de tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:09.996413 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-33eb55df-901c-44bb-bcb0-495cdaf28e09 req-1d23374b-4d5f-4896-a71b-f6ad013208de tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.0956931
Jun 01 06:18:10.058596 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-33eb55df-901c-44bb-bcb0-495cdaf28e09 req-51cbc20d-abbe-4a0f-aa08-8ffcc6915049 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0559070
Jun 01 06:18:11.226388 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:11.269683 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfb71f26-492e-478d-a647-ddb01f7797db req-a0f66cf3-de09-4672-9332-1143b6b7bca4 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:11.271230 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cfb71f26-492e-478d-a647-ddb01f7797db req-a0f66cf3-de09-4672-9332-1143b6b7bca4 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.0922315
Jun 01 06:18:11.333410 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cfb71f26-492e-478d-a647-ddb01f7797db req-c27610f6-1fb4-4ec9-a6f8-eeeb0096626a tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0554302
Jun 01 06:18:12.345954 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-85bca087-8ff5-4b7b-b95c-a622a282ff3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:12.534903 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6a803e6-84f4-411d-b064-e8fdd2e42cf1 req-9a2e27e5-9bde-42f3-b21a-35f0e4d05581 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:12.536350 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e6a803e6-84f4-411d-b064-e8fdd2e42cf1 req-9a2e27e5-9bde-42f3-b21a-35f0e4d05581 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.0826576
Jun 01 06:18:12.585448 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e6a803e6-84f4-411d-b064-e8fdd2e42cf1 req-0025ae5f-2381-432c-b859-2e28aaf7f9a0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0423207
Jun 01 06:18:13.277452 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:13.807289 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a03e582b-f448-4a6c-9c32-b5bca7e2c549 req-a472f1e0-de97-4264-b316-a8f5b6fae7ba tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:13.809135 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a03e582b-f448-4a6c-9c32-b5bca7e2c549 req-a472f1e0-de97-4264-b316-a8f5b6fae7ba tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.1016622
Jun 01 06:18:13.876507 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a03e582b-f448-4a6c-9c32-b5bca7e2c549 req-2cf86bd7-c01b-4373-b957-f3d061b76df9 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0613434
Jun 01 06:18:15.095252 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-093d7fa7-8ccc-4312-b5a2-b0c778c990fa req-4ec49c14-d06f-4855-920a-acc067c370de tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:15.096848 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-093d7fa7-8ccc-4312-b5a2-b0c778c990fa req-4ec49c14-d06f-4855-920a-acc067c370de tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.0946698
Jun 01 06:18:15.150496 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-093d7fa7-8ccc-4312-b5a2-b0c778c990fa req-f33bb812-999d-47dc-87a9-abfec08a29dc tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&id=8b6148b9-b790-4563-ad28-9c548198b033&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0475421
Jun 01 06:18:15.377625 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:15.990983 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:16.724569 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:18:19.926811 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39614) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:20.056369 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-fe829816-3028-45bb-8082-ee3332e80b4e admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:20.071952 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-fe829816-3028-45bb-8082-ee3332e80b4e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:18:20.076247 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-fe829816-3028-45bb-8082-ee3332e80b4e admin admin] Usage tracker for resource:security_group_rule and tenant:e85a828ddcdd4d6fa2560aa02273acbd is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:18:20.079146 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-fe829816-3028-45bb-8082-ee3332e80b4e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:18:20.085051 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-fe829816-3028-45bb-8082-ee3332e80b4e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:18:20.173838 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-fe829816-3028-45bb-8082-ee3332e80b4e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:20.177684 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-fe829816-3028-45bb-8082-ee3332e80b4e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:20.185850 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e92b3783-6719-4567-bd81-ab2f85ea8df7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:20.230809 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-fe829816-3028-45bb-8082-ee3332e80b4e admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=e85a828ddcdd4d6fa2560aa02273acbd&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3028922
Jun 01 06:18:20.231900 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe829816-3028-45bb-8082-ee3332e80b4e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=33daed5f-325a-40da-8026-0cb9f1d1b181,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:20.233575 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 39620) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:20.235145 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-fe829816-3028-45bb-8082-ee3332e80b4e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:20.297791 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-fa765ae5-b210-4236-86cc-eb9de7b3617d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:20.329159 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-fa765ae5-b210-4236-86cc-eb9de7b3617d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:20.389834 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-fa765ae5-b210-4236-86cc-eb9de7b3617d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:20.393752 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-bc98b0b6-d2bf-4e26-b740-8c58dfb076c1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:20.408891 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa765ae5-b210-4236-86cc-eb9de7b3617d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=33daed5f-325a-40da-8026-0cb9f1d1b181,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:20.411328 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-fa765ae5-b210-4236-86cc-eb9de7b3617d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:20.413609 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-fa765ae5-b210-4236-86cc-eb9de7b3617d admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:20.417763 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-fa765ae5-b210-4236-86cc-eb9de7b3617d admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/33daed5f-325a-40da-8026-0cb9f1d1b181 HTTP/1.1" status: 204  len: 168 time: 0.1801646
Jun 01 06:18:20.724238 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39628) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:20.822283 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-70cf4fbc-12b2-4b23-b431-9a0df5d5f815 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:20.837435 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-70cf4fbc-12b2-4b23-b431-9a0df5d5f815 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:18:20.842769 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-70cf4fbc-12b2-4b23-b431-9a0df5d5f815 admin admin] Usage tracker for resource:security_group_rule and tenant:5265b84078d547d287f023e31676b7fa is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:18:20.845624 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-70cf4fbc-12b2-4b23-b431-9a0df5d5f815 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:18:20.851402 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-70cf4fbc-12b2-4b23-b431-9a0df5d5f815 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:18:20.938655 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-70cf4fbc-12b2-4b23-b431-9a0df5d5f815 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:20.942581 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-70cf4fbc-12b2-4b23-b431-9a0df5d5f815 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:20.950377 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-224905f9-c96e-4ffe-a108-1a292122bd3d tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:20.993361 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-70cf4fbc-12b2-4b23-b431-9a0df5d5f815 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=5265b84078d547d287f023e31676b7fa&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2680159
Jun 01 06:18:20.994313 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70cf4fbc-12b2-4b23-b431-9a0df5d5f815 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=48f56671-f2e9-4ee3-954c-d401ffeb6822,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:20.996635 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 39632) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:20.998211 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-70cf4fbc-12b2-4b23-b431-9a0df5d5f815 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:21.065360 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d0ed7ec5-c18d-4f4e-aa91-1f1cb87198fd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:21.093894 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d0ed7ec5-c18d-4f4e-aa91-1f1cb87198fd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:21.148106 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d0ed7ec5-c18d-4f4e-aa91-1f1cb87198fd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:21.153330 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-cf7ca0ed-8de2-499f-8ed3-df9b0feaec52 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:21.163734 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0ed7ec5-c18d-4f4e-aa91-1f1cb87198fd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=48f56671-f2e9-4ee3-954c-d401ffeb6822,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:21.167732 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-d0ed7ec5-c18d-4f4e-aa91-1f1cb87198fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:21.171016 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-d0ed7ec5-c18d-4f4e-aa91-1f1cb87198fd admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:21.172152 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-d0ed7ec5-c18d-4f4e-aa91-1f1cb87198fd admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/48f56671-f2e9-4ee3-954c-d401ffeb6822 HTTP/1.1" status: 204  len: 168 time: 0.1744907
Jun 01 06:18:24.058502 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 39706) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:24.181940 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-0b24fdd9-777a-4994-8ea4-88ad4f6103f4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:24.202630 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-0b24fdd9-777a-4994-8ea4-88ad4f6103f4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:18:24.206667 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-0b24fdd9-777a-4994-8ea4-88ad4f6103f4 admin admin] Usage tracker for resource:security_group_rule and tenant:e62bae3829564459bfecde34f8626734 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:18:24.209507 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-0b24fdd9-777a-4994-8ea4-88ad4f6103f4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:18:24.215679 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-0b24fdd9-777a-4994-8ea4-88ad4f6103f4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:18:24.301402 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-0b24fdd9-777a-4994-8ea4-88ad4f6103f4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:24.305258 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-0b24fdd9-777a-4994-8ea4-88ad4f6103f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:24.312809 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-4dd3de13-20c1-485d-a988-80ba8161894b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:24.358095 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-0b24fdd9-777a-4994-8ea4-88ad4f6103f4 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=e62bae3829564459bfecde34f8626734&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2959516
Jun 01 06:18:24.358095 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b24fdd9-777a-4994-8ea4-88ad4f6103f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d6a1c9dc-1e4e-4a6d-a4d2-31485482793f,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:24.358425 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39712) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:24.359426 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-0b24fdd9-777a-4994-8ea4-88ad4f6103f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:24.420769 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9e2865c3-d306-44f8-b1f5-e0e51d204494 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:24.452706 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9e2865c3-d306-44f8-b1f5-e0e51d204494 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:24.507908 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9e2865c3-d306-44f8-b1f5-e0e51d204494 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:24.512890 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-af2f75cf-ab2a-4115-98a7-298e8c93047d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:24.527726 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e2865c3-d306-44f8-b1f5-e0e51d204494 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d6a1c9dc-1e4e-4a6d-a4d2-31485482793f,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:24.530640 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-9e2865c3-d306-44f8-b1f5-e0e51d204494 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:24.539956 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9e2865c3-d306-44f8-b1f5-e0e51d204494 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:24.541080 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-9e2865c3-d306-44f8-b1f5-e0e51d204494 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/d6a1c9dc-1e4e-4a6d-a4d2-31485482793f HTTP/1.1" status: 204  len: 168 time: 0.1816373
Jun 01 06:18:24.863173 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39720) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:24.883000 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3ea9342b-bfde-419c-90d1-fac023bef60b admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:24.899545 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-3ea9342b-bfde-419c-90d1-fac023bef60b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:18:24.905103 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-3ea9342b-bfde-419c-90d1-fac023bef60b admin admin] Usage tracker for resource:security_group_rule and tenant:df1e044f2e2342fc836e0c0109cf1596 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:18:24.908033 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-3ea9342b-bfde-419c-90d1-fac023bef60b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:18:24.913799 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-3ea9342b-bfde-419c-90d1-fac023bef60b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:18:25.006282 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3ea9342b-bfde-419c-90d1-fac023bef60b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:25.010939 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3ea9342b-bfde-419c-90d1-fac023bef60b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:25.018196 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-1011dbf6-4d1e-420f-80a7-ea8533e68831 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:25.060900 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-3ea9342b-bfde-419c-90d1-fac023bef60b admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=df1e044f2e2342fc836e0c0109cf1596&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1962690
Jun 01 06:18:25.061875 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ea9342b-bfde-419c-90d1-fac023bef60b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=31a04e00-2325-4bd9-a5e4-a42a07c722fa,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:25.063863 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 39726) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:25.065149 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-3ea9342b-bfde-419c-90d1-fac023bef60b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:25.134704 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7e76e651-1049-4de6-b9df-e5a9022828b9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:25.161859 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7e76e651-1049-4de6-b9df-e5a9022828b9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:25.221558 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7e76e651-1049-4de6-b9df-e5a9022828b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:25.232255 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-d09b9ae4-f399-453a-832a-a7655a96e58d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:25.262004 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e76e651-1049-4de6-b9df-e5a9022828b9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=31a04e00-2325-4bd9-a5e4-a42a07c722fa,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:25.270999 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-7e76e651-1049-4de6-b9df-e5a9022828b9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:25.278841 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7e76e651-1049-4de6-b9df-e5a9022828b9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:25.279984 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-7e76e651-1049-4de6-b9df-e5a9022828b9 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/31a04e00-2325-4bd9-a5e4-a42a07c722fa HTTP/1.1" status: 204  len: 168 time: 0.2153594
Jun 01 06:18:26.281109 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 39756) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:26.569482 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [None req-261be639-9737-492c-8215-d7bdf53d4497 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Deleting port cd749d9c-9a1b-4d38-a1a9-d0bcde1eb7a1 {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:18:26.569824 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-261be639-9737-492c-8215-d7bdf53d4497 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:26.781920 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-261be639-9737-492c-8215-d7bdf53d4497 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:26.782137 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-261be639-9737-492c-8215-d7bdf53d4497 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:26.904475 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [None req-261be639-9737-492c-8215-d7bdf53d4497 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Calling delete_port for cd749d9c-9a1b-4d38-a1a9-d0bcde1eb7a1 owned by network:floatingip {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:18:27.036348 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-261be639-9737-492c-8215-d7bdf53d4497 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:27.040131 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-39d72950-79cd-425d-9871-6939d82c4c3b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:27.086828 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-261be639-9737-492c-8215-d7bdf53d4497 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Pushing event deleted for resources: {'Port': ['ID=cd749d9c-9a1b-4d38-a1a9-d0bcde1eb7a1,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:27.090251 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-261be639-9737-492c-8215-d7bdf53d4497 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:27.182980 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-261be639-9737-492c-8215-d7bdf53d4497 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for floatingip, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:27.183303 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.db.l3_db [None req-261be639-9737-492c-8215-d7bdf53d4497 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Floating IP 5ed9ba98-8f9b-451e-b481-f30502ca4a26 disassociated (deleted). External IP: 172.27.2.215, port: 6c07ed73-1eed-4e63-90ca-60843e890090.
Jun 01 06:18:27.537807 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-261be639-9737-492c-8215-d7bdf53d4497 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Router 4b10a529-195d-4706-87d3-f422588c7516 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92229) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:18:27.717726 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-261be639-9737-492c-8215-d7bdf53d4497 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92229) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:18:27.726987 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-589f1030-a18a-499b-b0c0-723e6fdab8d5 None None] Sync routers for ids ['4b10a529-195d-4706-87d3-f422588c7516'] in dv-cinder-793885-1-iscsi {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:18:27.732379 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-261be639-9737-492c-8215-d7bdf53d4497 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for floatingip, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:27.737285 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-589f1030-a18a-499b-b0c0-723e6fdab8d5 None None] Routers {'4b10a529-195d-4706-87d3-f422588c7516'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:18:27.737894 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-589f1030-a18a-499b-b0c0-723e6fdab8d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b25ac9d0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:18:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['4b10a529-195d-4706-87d3-f422588c7516'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:27.786874 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-261be639-9737-492c-8215-d7bdf53d4497 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "DELETE /v2.0/floatingips/5ed9ba98-8f9b-451e-b481-f30502ca4a26 HTTP/1.1" status: 204  len: 168 time: 1.5046799
Jun 01 06:18:27.787519 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a8503e6f-cd18-456e-9b8d-c60b093a7c7f', 'tag': '6c07ed73-1eed-4e63-90ca-60843e890090'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:18:27.789889 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1a251a1c-2d7c-4f8a-8b15-eaffd2cf625a" -d '{"events": [{"name": "network-changed", "server_uuid": "a8503e6f-cd18-456e-9b8d-c60b093a7c7f", "tag": "6c07ed73-1eed-4e63-90ca-60843e890090"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:18:27.840681 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:18:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-238f5a67-f029-4299-b917-9de429f25273 x-openstack-request-id: req-238f5a67-f029-4299-b917-9de429f25273 {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:18:27.841002 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a8503e6f-cd18-456e-9b8d-c60b093a7c7f", "tag": "6c07ed73-1eed-4e63-90ca-60843e890090", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:18:27.841291 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-238f5a67-f029-4299-b917-9de429f25273 {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:18:27.842023 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a8503e6f-cd18-456e-9b8d-c60b093a7c7f', 'tag': '6c07ed73-1eed-4e63-90ca-60843e890090', 'status': 'completed', 'code': 200}
Jun 01 06:18:27.923393 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-589f1030-a18a-499b-b0c0-723e6fdab8d5 None None] Set router 4b10a529-195d-4706-87d3-f422588c7516 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:18:27.984842 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a251a1c-2d7c-4f8a-8b15-eaffd2cf625a req-8e0b6b04-afa0-47f5-a520-1edef6bc2848 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:27.987065 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1a251a1c-2d7c-4f8a-8b15-eaffd2cf625a req-8e0b6b04-afa0-47f5-a520-1edef6bc2848 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=60be617f683c42a081ab3f50c3bdf8f1&device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 1099 time: 0.1177113
Jun 01 06:18:28.153904 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a251a1c-2d7c-4f8a-8b15-eaffd2cf625a req-d1c27fba-f418-4d7e-adda-3e3d8303bee4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:28.155366 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1a251a1c-2d7c-4f8a-8b15-eaffd2cf625a req-d1c27fba-f418-4d7e-adda-3e3d8303bee4 service neutron] 10.222.0.48 "GET /v2.0/networks?id=6200246e-b324-4384-a0a9-6dc6726e2c6d HTTP/1.1" status: 200  len: 910 time: 0.1618004
Jun 01 06:18:28.237817 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1a251a1c-2d7c-4f8a-8b15-eaffd2cf625a req-01b562b3-8ff0-40e5-a682-8aaa0790d697 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=6c07ed73-1eed-4e63-90ca-60843e890090 HTTP/1.1" status: 200  len: 217 time: 0.0749893
Jun 01 06:18:28.276215 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-589f1030-a18a-499b-b0c0-723e6fdab8d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b25ac9d0>, [{'id': '4b10a529-195d-4706-87d3-f422588c7516', 'name': 'tempest-TestShelveInstance-1811865016-router', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74'}], 'enable_snat': True}, 'gw_port_id': '2ff74456-d8aa-477a-a634-aca56832439b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:06Z', 'updated_at': '2021-06-01T06:13:12Z', 'revision_number': 4, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'gw_port': {'id': '2ff74456-d8aa-477a-a634-aca56832439b', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:52:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b10a529-195d-4706-87d3-f422588c7516', 'device_owner': 'network:router_gateway', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:07Z', 'updated_at': '2021-06-01T06:13:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '9708fa96-563b-40e8-9c0f-8540e15e4126', 'name': '', 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'mac_address': 'fa:16:3e:06:43:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b10a529-195d-4706-87d3-f422588c7516', 'device_owner': 'network:router_interface', 'standard_attr_id': 315, 'fixed_ips': [{'subnet_id': '1fbcd64f-1378-4ec3-bd16-df65964c6028', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:11Z', 'updated_at': '2021-06-01T06:13:21Z', 'revision_number': 5, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'subnets': [{'id': '1fbcd64f-1378-4ec3-bd16-df65964c6028', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:28.281574 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-589f1030-a18a-499b-b0c0-723e6fdab8d5 None None] Checking router: 4b10a529-195d-4706-87d3-f422588c7516 for host: dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:18:28.292748 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-589f1030-a18a-499b-b0c0-723e6fdab8d5 None None] Routers {'4b10a529-195d-4706-87d3-f422588c7516'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:18:28.293704 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-589f1030-a18a-499b-b0c0-723e6fdab8d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b25ac9d0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:18:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['4b10a529-195d-4706-87d3-f422588c7516'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:28.310064 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a251a1c-2d7c-4f8a-8b15-eaffd2cf625a req-362d6398-1d93-41ce-9c01-4d19d1e69c35 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:28.311824 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1a251a1c-2d7c-4f8a-8b15-eaffd2cf625a req-362d6398-1d93-41ce-9c01-4d19d1e69c35 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=1fbcd64f-1378-4ec3-bd16-df65964c6028 HTTP/1.1" status: 200  len: 848 time: 0.0655589
Jun 01 06:18:28.519254 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-589f1030-a18a-499b-b0c0-723e6fdab8d5 None None] Set router 4b10a529-195d-4706-87d3-f422588c7516 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:18:28.554462 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a251a1c-2d7c-4f8a-8b15-eaffd2cf625a req-afb3cace-a20e-4d7b-a30f-cf6740d14322 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:28.555972 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1a251a1c-2d7c-4f8a-8b15-eaffd2cf625a req-afb3cace-a20e-4d7b-a30f-cf6740d14322 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=6200246e-b324-4384-a0a9-6dc6726e2c6d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2356212
Jun 01 06:18:28.565060 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc718a95-e3b7-41ce-a484-4127ad072389 req-0c710adb-89c3-4282-9ac5-e0e5a844383b tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:28.565672 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-cc718a95-e3b7-41ce-a484-4127ad072389 req-0c710adb-89c3-4282-9ac5-e0e5a844383b tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Synchronizing usage tracker for tenant:60be617f683c42a081ab3f50c3bdf8f1 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:18:28.668234 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-cc718a95-e3b7-41ce-a484-4127ad072389 req-0c710adb-89c3-4282-9ac5-e0e5a844383b tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Unset dirty status for tenant:60be617f683c42a081ab3f50c3bdf8f1 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:18:28.669385 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cc718a95-e3b7-41ce-a484-4127ad072389 req-0c710adb-89c3-4282-9ac5-e0e5a844383b tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 946 time: 0.2173004
Jun 01 06:18:28.738090 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1a251a1c-2d7c-4f8a-8b15-eaffd2cf625a req-32e0df2b-dda5-4f3b-a69b-242a05547702 service neutron] 10.222.0.48 "GET /v2.0/networks/6200246e-b324-4384-a0a9-6dc6726e2c6d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1695523
Jun 01 06:18:28.748780 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cc718a95-e3b7-41ce-a484-4127ad072389 req-3630a474-bf34-41ae-8017-ce3d26d6f52f tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0618861
Jun 01 06:18:28.845836 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-589f1030-a18a-499b-b0c0-723e6fdab8d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b25ac9d0>, [{'id': '4b10a529-195d-4706-87d3-f422588c7516', 'name': 'tempest-TestShelveInstance-1811865016-router', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74'}], 'enable_snat': True}, 'gw_port_id': '2ff74456-d8aa-477a-a634-aca56832439b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:06Z', 'updated_at': '2021-06-01T06:13:12Z', 'revision_number': 4, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'gw_port': {'id': '2ff74456-d8aa-477a-a634-aca56832439b', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:52:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b10a529-195d-4706-87d3-f422588c7516', 'device_owner': 'network:router_gateway', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:07Z', 'updated_at': '2021-06-01T06:13:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '9708fa96-563b-40e8-9c0f-8540e15e4126', 'name': '', 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'mac_address': 'fa:16:3e:06:43:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b10a529-195d-4706-87d3-f422588c7516', 'device_owner': 'network:router_interface', 'standard_attr_id': 315, 'fixed_ips': [{'subnet_id': '1fbcd64f-1378-4ec3-bd16-df65964c6028', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:11Z', 'updated_at': '2021-06-01T06:13:21Z', 'revision_number': 5, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'subnets': [{'id': '1fbcd64f-1378-4ec3-bd16-df65964c6028', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:28.849704 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-589f1030-a18a-499b-b0c0-723e6fdab8d5 None None] The sync data for ids ['4b10a529-195d-4706-87d3-f422588c7516'] in dv-cinder-793885-1-iscsi is: [{'id': '4b10a529-195d-4706-87d3-f422588c7516', 'name': 'tempest-TestShelveInstance-1811865016-router', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74'}], 'enable_snat': True}, 'gw_port_id': '2ff74456-d8aa-477a-a634-aca56832439b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:06Z', 'updated_at': '2021-06-01T06:13:12Z', 'revision_number': 4, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'gw_port': {'id': '2ff74456-d8aa-477a-a634-aca56832439b', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:52:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b10a529-195d-4706-87d3-f422588c7516', 'device_owner': 'network:router_gateway', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:07Z', 'updated_at': '2021-06-01T06:13:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '9708fa96-563b-40e8-9c0f-8540e15e4126', 'name': '', 'network_id': '6200246e-b324-4384-a0a9-6dc6726e2c6d', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'mac_address': 'fa:16:3e:06:43:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b10a529-195d-4706-87d3-f422588c7516', 'device_owner': 'network:router_interface', 'standard_attr_id': 315, 'fixed_ips': [{'subnet_id': '1fbcd64f-1378-4ec3-bd16-df65964c6028', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:11Z', 'updated_at': '2021-06-01T06:13:21Z', 'revision_number': 5, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'subnets': [{'id': '1fbcd64f-1378-4ec3-bd16-df65964c6028', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:18:28.879895 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1a251a1c-2d7c-4f8a-8b15-eaffd2cf625a req-92d3efad-b8e5-4432-aebd-e460abdcbbc2 service neutron] 10.222.0.48 "GET /v2.0/networks/6200246e-b324-4384-a0a9-6dc6726e2c6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1301610
Jun 01 06:18:29.063905 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa60fb8d-0464-4337-a379-1aa1867f16f7 None None] New status for floating IP 5ed9ba98-8f9b-451e-b481-f30502ca4a26: DOWN {{(pid=92231) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 06:18:29.424066 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 39788) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:29.545157 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-c6f42d95-0803-425a-868b-9985ef98563f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:29.559810 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-c6f42d95-0803-425a-868b-9985ef98563f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:18:29.563919 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-c6f42d95-0803-425a-868b-9985ef98563f admin admin] Usage tracker for resource:security_group_rule and tenant:b1db00ec807d44739e836974735608ea is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:18:29.566855 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-c6f42d95-0803-425a-868b-9985ef98563f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:18:29.573597 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-c6f42d95-0803-425a-868b-9985ef98563f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:18:29.655762 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-c6f42d95-0803-425a-868b-9985ef98563f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:29.659138 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-c6f42d95-0803-425a-868b-9985ef98563f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:29.665979 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-6e5fb843-414e-4ed0-a725-ceb4c7de88b2 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:29.708153 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-c6f42d95-0803-425a-868b-9985ef98563f admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=b1db00ec807d44739e836974735608ea&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2829154
Jun 01 06:18:29.708979 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6f42d95-0803-425a-868b-9985ef98563f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f9f6986b-c6d8-4ef7-9e21-fe9742b2a686,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:29.711570 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39794) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:29.712143 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-c6f42d95-0803-425a-868b-9985ef98563f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:29.775507 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-58a1a363-17bf-43f6-aa9c-32a216a4b558 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:29.801827 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-58a1a363-17bf-43f6-aa9c-32a216a4b558 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:29.853356 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-58a1a363-17bf-43f6-aa9c-32a216a4b558 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:29.857333 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-ed95a6f6-adf3-4a86-b5be-aa6597a6294a tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:29.871168 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58a1a363-17bf-43f6-aa9c-32a216a4b558 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f9f6986b-c6d8-4ef7-9e21-fe9742b2a686,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:29.875080 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-58a1a363-17bf-43f6-aa9c-32a216a4b558 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:29.880938 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-58a1a363-17bf-43f6-aa9c-32a216a4b558 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:29.884365 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-58a1a363-17bf-43f6-aa9c-32a216a4b558 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/f9f6986b-c6d8-4ef7-9e21-fe9742b2a686 HTTP/1.1" status: 204  len: 168 time: 0.1694760
Jun 01 06:18:29.951409 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-655bcfc5-6fef-4f60-be62-94e38c4e5ed2 req-d126a3a7-52a1-49c3-a660-ab7c45458b81 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:29.953034 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-655bcfc5-6fef-4f60-be62-94e38c4e5ed2 req-d126a3a7-52a1-49c3-a660-ab7c45458b81 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 946 time: 0.0909393
Jun 01 06:18:30.050241 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-655bcfc5-6fef-4f60-be62-94e38c4e5ed2 req-0b3d35bb-2cc0-4a25-aa2f-0a4ec337098d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/security-groups?id=659a9ce0-c758-4944-9feb-468439eee519&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0905797
Jun 01 06:18:30.079118 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca28fef0-7e23-450d-830c-b3d482e07599 req-9effc153-23d4-4a0c-81cb-823cc57eb8e9 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:30.080587 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ca28fef0-7e23-450d-830c-b3d482e07599 req-9effc153-23d4-4a0c-81cb-823cc57eb8e9 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.48 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 946 time: 0.1058147
Jun 01 06:18:30.220069 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-ca28fef0-7e23-450d-830c-b3d482e07599 req-7a827f18-32bb-4f57-ad28-a765139f3484 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Deleting port 6c07ed73-1eed-4e63-90ca-60843e890090 {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:18:30.220420 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-ca28fef0-7e23-450d-830c-b3d482e07599 req-7a827f18-32bb-4f57-ad28-a765139f3484 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:30.374765 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-ca28fef0-7e23-450d-830c-b3d482e07599 req-7a827f18-32bb-4f57-ad28-a765139f3484 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] For port 6c07ed73-1eed-4e63-90ca-60843e890090, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=6c07ed73-1eed-4e63-90ca-60843e890090,segment=NetworkSegment(fd926c6b-9e42-4104-afe3-51ec344ecdd5),segment_id=fd926c6b-9e42-4104-afe3-51ec344ecdd5)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:18:30.375150 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-ca28fef0-7e23-450d-830c-b3d482e07599 req-7a827f18-32bb-4f57-ad28-a765139f3484 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:30.505700 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-ca28fef0-7e23-450d-830c-b3d482e07599 req-7a827f18-32bb-4f57-ad28-a765139f3484 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Calling delete_port for 6c07ed73-1eed-4e63-90ca-60843e890090 owned by compute:nova {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:18:30.621617 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-ca28fef0-7e23-450d-830c-b3d482e07599 req-7a827f18-32bb-4f57-ad28-a765139f3484 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:30.627585 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:30.674908 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a827f18-32bb-4f57-ad28-a765139f3484 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Pushing event deleted for resources: {'Port': ['ID=6c07ed73-1eed-4e63-90ca-60843e890090,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:30.678056 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-7a827f18-32bb-4f57-ad28-a765139f3484 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:30.761571 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-ca28fef0-7e23-450d-830c-b3d482e07599 req-7a827f18-32bb-4f57-ad28-a765139f3484 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] No DVR routers for this DVR port 6c07ed73-1eed-4e63-90ca-60843e890090 on host hv-cinder-79388 {{(pid=92229) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:18:30.764187 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-ca28fef0-7e23-450d-830c-b3d482e07599 req-7a827f18-32bb-4f57-ad28-a765139f3484 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:30.767053 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a8503e6f-cd18-456e-9b8d-c60b093a7c7f', 'name': 'network-vif-deleted', 'tag': '6c07ed73-1eed-4e63-90ca-60843e890090'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:18:30.769357 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-74a33811-75fd-41a3-af86-6ea52858269c" -d '{"events": [{"server_uuid": "a8503e6f-cd18-456e-9b8d-c60b093a7c7f", "name": "network-vif-deleted", "tag": "6c07ed73-1eed-4e63-90ca-60843e890090"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:18:30.790105 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ca28fef0-7e23-450d-830c-b3d482e07599 req-7a827f18-32bb-4f57-ad28-a765139f3484 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.48 "DELETE /v2.0/ports/6c07ed73-1eed-4e63-90ca-60843e890090 HTTP/1.1" status: 204  len: 173 time: 0.7032404
Jun 01 06:18:30.818821 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:18:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a1d19b81-3465-49e7-86f2-96d1786b481c x-openstack-request-id: req-a1d19b81-3465-49e7-86f2-96d1786b481c {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:18:30.819155 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a8503e6f-cd18-456e-9b8d-c60b093a7c7f", "name": "network-vif-deleted", "tag": "6c07ed73-1eed-4e63-90ca-60843e890090", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:18:30.819446 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-a1d19b81-3465-49e7-86f2-96d1786b481c {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:18:30.819912 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a8503e6f-cd18-456e-9b8d-c60b093a7c7f', 'name': 'network-vif-deleted', 'tag': '6c07ed73-1eed-4e63-90ca-60843e890090', 'status': 'completed', 'code': 200}
Jun 01 06:18:31.223169 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-371d1050-a969-40c9-98f7-5aaa3aa88bde req-f18c4fb2-12ca-4352-a132-599f1e102ed7 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Synchronizing usage tracker for tenant:60be617f683c42a081ab3f50c3bdf8f1 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:18:31.239458 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-371d1050-a969-40c9-98f7-5aaa3aa88bde req-f18c4fb2-12ca-4352-a132-599f1e102ed7 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Unset dirty status for tenant:60be617f683c42a081ab3f50c3bdf8f1 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:18:31.240948 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-371d1050-a969-40c9-98f7-5aaa3aa88bde req-f18c4fb2-12ca-4352-a132-599f1e102ed7 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "GET /v2.0/ports?device_id=a8503e6f-cd18-456e-9b8d-c60b093a7c7f HTTP/1.1" status: 200  len: 210 time: 0.0682430
Jun 01 06:18:32.344734 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39886) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:32.416776 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d63af1c8-cfb8-4539-8935-489f97e72e1d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:32.452730 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d63af1c8-cfb8-4539-8935-489f97e72e1d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:32.528217 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d63af1c8-cfb8-4539-8935-489f97e72e1d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:32.532121 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-5c05df70-63bc-4c3f-bde4-d32b448c906f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:32.546676 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d63af1c8-cfb8-4539-8935-489f97e72e1d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=659a9ce0-c758-4944-9feb-468439eee519,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:32.549794 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-d63af1c8-cfb8-4539-8935-489f97e72e1d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:32.559573 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d63af1c8-cfb8-4539-8935-489f97e72e1d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:32.560971 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-d63af1c8-cfb8-4539-8935-489f97e72e1d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] 10.222.0.25 "DELETE /v2.0/security-groups/659a9ce0-c758-4944-9feb-468439eee519 HTTP/1.1" status: 204  len: 168 time: 0.2148693
Jun 01 06:18:32.611039 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39894) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:33.340945 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b2b5eedc-f794-4344-98bc-a6fefd090ede admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-744138'] for router_interface, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:33.699642 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-959872de-30e9-4453-b2ea-68e4004ccdeb req-f426e476-0024-4c25-bf0b-1081da5e1a30 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:33.700967 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-959872de-30e9-4453-b2ea-68e4004ccdeb req-f426e476-0024-4c25-bf0b-1081da5e1a30 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 946 time: 0.0978136
Jun 01 06:18:33.752228 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-959872de-30e9-4453-b2ea-68e4004ccdeb req-c4bbdbf9-88e8-4881-8304-12b80c158a85 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0454173
Jun 01 06:18:33.778759 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-b2b5eedc-f794-4344-98bc-a6fefd090ede admin admin] Deleting port 9708fa96-563b-40e8-9c0f-8540e15e4126 {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:18:33.779312 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b2b5eedc-f794-4344-98bc-a6fefd090ede admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:34.005176 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [None req-b2b5eedc-f794-4344-98bc-a6fefd090ede admin admin] For port 9708fa96-563b-40e8-9c0f-8540e15e4126, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=9708fa96-563b-40e8-9c0f-8540e15e4126,segment=NetworkSegment(fd926c6b-9e42-4104-afe3-51ec344ecdd5),segment_id=fd926c6b-9e42-4104-afe3-51ec344ecdd5)] {{(pid=92230) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:18:34.005427 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b2b5eedc-f794-4344-98bc-a6fefd090ede admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:34.135229 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-b2b5eedc-f794-4344-98bc-a6fefd090ede admin admin] Calling delete_port for 9708fa96-563b-40e8-9c0f-8540e15e4126 owned by network:router_interface {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:18:34.287993 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b2b5eedc-f794-4344-98bc-a6fefd090ede admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:34.293929 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-861f0d1e-6efb-47bc-8a8d-8d727ef824c0 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:34.339563 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2b5eedc-f794-4344-98bc-a6fefd090ede admin admin] Pushing event deleted for resources: {'Port': ['ID=9708fa96-563b-40e8-9c0f-8540e15e4126,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:34.342552 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-b2b5eedc-f794-4344-98bc-a6fefd090ede admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:34.623302 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b2b5eedc-f794-4344-98bc-a6fefd090ede admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-581113', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-746586'] for router_interface, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:34.955501 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b1a05b-a813-4ce4-ada8-3f4db0a798fa req-d6d4aec0-7abd-493b-8f81-c5cce5a17639 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:34.956929 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a5b1a05b-a813-4ce4-ada8-3f4db0a798fa req-d6d4aec0-7abd-493b-8f81-c5cce5a17639 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 946 time: 0.0878544
Jun 01 06:18:35.004839 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b2b5eedc-f794-4344-98bc-a6fefd090ede admin admin] Router 4b10a529-195d-4706-87d3-f422588c7516 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92230) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:18:35.011916 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a5b1a05b-a813-4ce4-ada8-3f4db0a798fa req-0f74acd8-a8f3-4721-be27-23c4c1e44b20 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups?id=82c902b9-bc90-4df0-adf7-1e67365c9650&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0489683
Jun 01 06:18:35.039488 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 6c07ed73-1eed-4e63-90ca-60843e890090 no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:18:35.105000 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] No Port match for: 6c07ed73-1eed-4e63-90ca-60843e890090 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:18:35.105554 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 6c07ed73-1eed-4e63-90ca-60843e890090 not bound to the agent host hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:18:35.237821 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b2b5eedc-f794-4344-98bc-a6fefd090ede admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:18:35.247710 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01e952f0-8087-4c02-9f50-15785a3e2ab8 None None] Sync routers for ids ['4b10a529-195d-4706-87d3-f422588c7516'] in dv-cinder-793885-1-iscsi {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:18:35.256041 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-b2b5eedc-f794-4344-98bc-a6fefd090ede admin admin] 10.222.0.25 "PUT /v2.0/routers/4b10a529-195d-4706-87d3-f422588c7516/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6438332
Jun 01 06:18:35.258738 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39914) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:35.263092 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01e952f0-8087-4c02-9f50-15785a3e2ab8 None None] Routers {'4b10a529-195d-4706-87d3-f422588c7516'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:18:35.264033 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-01e952f0-8087-4c02-9f50-15785a3e2ab8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b25ac8e0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:18:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['4b10a529-195d-4706-87d3-f422588c7516'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:35.376220 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd98a987-e469-456a-ac1a-2f5711c33ccf req-0bc94b2e-79af-476c-b074-2fe8bfbdc451 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:35.377949 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cd98a987-e469-456a-ac1a-2f5711c33ccf req-0bc94b2e-79af-476c-b074-2fe8bfbdc451 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.48 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 946 time: 0.1919725
Jun 01 06:18:35.453011 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-01e952f0-8087-4c02-9f50-15785a3e2ab8 None None] Set router 4b10a529-195d-4706-87d3-f422588c7516 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:18:35.524386 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-cd98a987-e469-456a-ac1a-2f5711c33ccf req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Deleting port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:18:35.524729 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-cd98a987-e469-456a-ac1a-2f5711c33ccf req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:35.554373 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-cc025b42-4f42-46bc-851f-165a945e4c3d admin admin] Notify callbacks [] for router, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:35.681063 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-cd98a987-e469-456a-ac1a-2f5711c33ccf req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] For port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=3a7e88d5-0834-4e15-acbc-90cd1b9bca61,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:18:35.681416 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-cd98a987-e469-456a-ac1a-2f5711c33ccf req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:35.744745 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-cc025b42-4f42-46bc-851f-165a945e4c3d admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:35.772319 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-01e952f0-8087-4c02-9f50-15785a3e2ab8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b25ac8e0>, [{'id': '4b10a529-195d-4706-87d3-f422588c7516', 'name': 'tempest-TestShelveInstance-1811865016-router', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74'}], 'enable_snat': True}, 'gw_port_id': '2ff74456-d8aa-477a-a634-aca56832439b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:06Z', 'updated_at': '2021-06-01T06:18:34Z', 'revision_number': 5, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'gw_port': {'id': '2ff74456-d8aa-477a-a634-aca56832439b', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:52:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b10a529-195d-4706-87d3-f422588c7516', 'device_owner': 'network:router_gateway', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:07Z', 'updated_at': '2021-06-01T06:13:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:35.777166 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01e952f0-8087-4c02-9f50-15785a3e2ab8 None None] Checking router: 4b10a529-195d-4706-87d3-f422588c7516 for host: dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:18:35.785551 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01e952f0-8087-4c02-9f50-15785a3e2ab8 None None] Routers {'4b10a529-195d-4706-87d3-f422588c7516'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:18:35.786152 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-01e952f0-8087-4c02-9f50-15785a3e2ab8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b25ac8e0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:18:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['4b10a529-195d-4706-87d3-f422588c7516'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:35.844182 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-cc025b42-4f42-46bc-851f-165a945e4c3d admin admin] Deleting port 2ff74456-d8aa-477a-a634-aca56832439b {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:18:35.844525 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-cc025b42-4f42-46bc-851f-165a945e4c3d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:35.958793 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-01e952f0-8087-4c02-9f50-15785a3e2ab8 None None] Set router 4b10a529-195d-4706-87d3-f422588c7516 gateway port host: None {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:18:35.989340 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [None req-cc025b42-4f42-46bc-851f-165a945e4c3d admin admin] For port 2ff74456-d8aa-477a-a634-aca56832439b, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=2ff74456-d8aa-477a-a634-aca56832439b,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92230) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:18:35.989694 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-cc025b42-4f42-46bc-851f-165a945e4c3d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:36.045566 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-cd98a987-e469-456a-ac1a-2f5711c33ccf req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:36.046161 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-cd98a987-e469-456a-ac1a-2f5711c33ccf req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-745720'] for floatingip, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:36.046750 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.db.l3_db [req-cd98a987-e469-456a-ac1a-2f5711c33ccf req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Floating IP 1295facd-b7bb-4e57-99f6-ffed145c70db disassociated. External IP: 172.27.2.3, port: 3a7e88d5-0834-4e15-acbc-90cd1b9bca61.
Jun 01 06:18:36.047302 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-cd98a987-e469-456a-ac1a-2f5711c33ccf req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Calling delete_port for 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 owned by compute:nova {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:18:36.114072 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-01e952f0-8087-4c02-9f50-15785a3e2ab8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b25ac8e0>, [{'id': '4b10a529-195d-4706-87d3-f422588c7516', 'name': 'tempest-TestShelveInstance-1811865016-router', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:06Z', 'updated_at': '2021-06-01T06:18:35Z', 'revision_number': 6, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'gw_port_host': None}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:36.118700 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01e952f0-8087-4c02-9f50-15785a3e2ab8 None None] The sync data for ids ['4b10a529-195d-4706-87d3-f422588c7516'] in dv-cinder-793885-1-iscsi is: [{'id': '4b10a529-195d-4706-87d3-f422588c7516', 'name': 'tempest-TestShelveInstance-1811865016-router', 'tenant_id': '60be617f683c42a081ab3f50c3bdf8f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:06Z', 'updated_at': '2021-06-01T06:18:35Z', 'revision_number': 6, 'project_id': '60be617f683c42a081ab3f50c3bdf8f1', 'gw_port_host': None}] {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:18:36.141505 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-cc025b42-4f42-46bc-851f-165a945e4c3d admin admin] Calling delete_port for 2ff74456-d8aa-477a-a634-aca56832439b owned by network:router_gateway {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:18:36.204241 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-cd98a987-e469-456a-ac1a-2f5711c33ccf req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:36.210871 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:36.260769 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Pushing event deleted for resources: {'Port': ['ID=3a7e88d5-0834-4e15-acbc-90cd1b9bca61,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:36.272825 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:36.273250 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:36.273611 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:36.274018 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:36.274373 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:36.275040 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:36.275183 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:36.275438 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:36.275836 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:36.276194 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:36.276588 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:36.276933 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:36.281060 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:36.337123 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-cc025b42-4f42-46bc-851f-165a945e4c3d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:36.342486 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-a72b7b91-1b5a-4c0f-b7ed-c978f0bad569 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:36.391166 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc025b42-4f42-46bc-851f-165a945e4c3d admin admin] Pushing event deleted for resources: {'Port': ['ID=2ff74456-d8aa-477a-a634-aca56832439b,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:36.394178 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-cc025b42-4f42-46bc-851f-165a945e4c3d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:36.405174 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-080ba6d1-bcb9-41eb-a4e3-4b691f76b4f1 req-e6bc4db2-4b21-4911-ac03-ce39777d27f9 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/ports?device_id=0504a6b7-2f41-4914-a3bb-2f908556d658 HTTP/1.1" status: 200  len: 210 time: 0.0662138
Jun 01 06:18:36.493137 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-cc025b42-4f42-46bc-851f-165a945e4c3d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-745687'] for router_gateway, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:36.530568 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.l3_agent_scheduler [req-cd98a987-e469-456a-ac1a-2f5711c33ccf req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Router b7bdc21e-592c-4bbf-87c9-5eba5676579e has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92229) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:18:36.696478 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-cc025b42-4f42-46bc-851f-165a945e4c3d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-748122', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-727'] for router, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:36.699603 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-cc025b42-4f42-46bc-851f-165a945e4c3d admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:36.726834 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-cc025b42-4f42-46bc-851f-165a945e4c3d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-746854'] for router, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:36.727378 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cc025b42-4f42-46bc-851f-165a945e4c3d admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4b10a529-195d-4706-87d3-f422588c7516 {{(pid=92230) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 06:18:36.748312 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-cc025b42-4f42-46bc-851f-165a945e4c3d admin admin] Notify callbacks [] for router, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:36.749755 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-cc025b42-4f42-46bc-851f-165a945e4c3d admin admin] 10.222.0.25 "DELETE /v2.0/routers/4b10a529-195d-4706-87d3-f422588c7516 HTTP/1.1" status: 204  len: 168 time: 1.4897664
Jun 01 06:18:36.752697 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 39924) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:36.802670 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-cd98a987-e469-456a-ac1a-2f5711c33ccf req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92229) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:18:36.813436 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6089426-b4f9-47f3-8e95-2d689c56926b None None] Sync routers for ids ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:18:36.823737 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6089426-b4f9-47f3-8e95-2d689c56926b None None] Routers {'b7bdc21e-592c-4bbf-87c9-5eba5676579e'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:18:36.824558 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-d6089426-b4f9-47f3-8e95-2d689c56926b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b288ef70>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:18:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:36.894817 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-cd98a987-e469-456a-ac1a-2f5711c33ccf req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] No DVR routers for this DVR port 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 on host hv-cinder-79388 {{(pid=92229) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:18:36.898850 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_v2 [None req-cc8d8ef6-bc67-4c52-8559-716f2b4b93d3 admin admin] Deleting subnet 1fbcd64f-1378-4ec3-bd16-df65964c6028 {{(pid=92229) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 06:18:36.902487 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-cd98a987-e469-456a-ac1a-2f5711c33ccf req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:36.907988 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0504a6b7-2f41-4914-a3bb-2f908556d658', 'name': 'network-vif-deleted', 'tag': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:18:36.910340 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-efbf113f-2b7d-4120-97a2-616436b5bbaf" -d '{"events": [{"server_uuid": "0504a6b7-2f41-4914-a3bb-2f908556d658", "name": "network-vif-deleted", "tag": "3a7e88d5-0834-4e15-acbc-90cd1b9bca61"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:18:36.913138 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-cc8d8ef6-bc67-4c52-8559-716f2b4b93d3 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:36.963258 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cd98a987-e469-456a-ac1a-2f5711c33ccf req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.48 "DELETE /v2.0/ports/3a7e88d5-0834-4e15-acbc-90cd1b9bca61 HTTP/1.1" status: 204  len: 173 time: 1.5787449
Jun 01 06:18:36.973776 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-cc8d8ef6-bc67-4c52-8559-716f2b4b93d3 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2127096'] for subnet, precommit_delete_associations {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:37.030040 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 9708fa96-563b-40e8-9c0f-8540e15e4126 no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:18:37.096474 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: 9708fa96-563b-40e8-9c0f-8540e15e4126 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:18:37.096761 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 9708fa96-563b-40e8-9c0f-8540e15e4126 not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:18:37.150182 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-d6089426-b4f9-47f3-8e95-2d689c56926b None None] Set router b7bdc21e-592c-4bbf-87c9-5eba5676579e gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:18:37.186757 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:18:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1aaf27fd-ffc4-4f26-b3b4-f18cd4b144ea x-openstack-request-id: req-1aaf27fd-ffc4-4f26-b3b4-f18cd4b144ea {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:18:37.187370 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0504a6b7-2f41-4914-a3bb-2f908556d658", "name": "network-vif-deleted", "tag": "3a7e88d5-0834-4e15-acbc-90cd1b9bca61", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:18:37.187589 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-1aaf27fd-ffc4-4f26-b3b4-f18cd4b144ea {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:18:37.188125 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0504a6b7-2f41-4914-a3bb-2f908556d658', 'name': 'network-vif-deleted', 'tag': '3a7e88d5-0834-4e15-acbc-90cd1b9bca61', 'status': 'completed', 'code': 200}
Jun 01 06:18:37.249419 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-cc8d8ef6-bc67-4c52-8559-716f2b4b93d3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8086245'] for subnet, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:37.542333 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-d6089426-b4f9-47f3-8e95-2d689c56926b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b288ef70>, [{'id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'name': 'tempest-AttachVolumeShelveTestJSON-921884409-router', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20'}], 'enable_snat': True}, 'gw_port_id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:24Z', 'updated_at': '2021-06-01T06:11:44Z', 'revision_number': 4, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'gw_port': {'id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:b4:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:27Z', 'updated_at': '2021-06-01T06:11:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '47f62b29-867e-4af1-9330-02c97cb95473', 'name': '', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'mac_address': 'fa:16:3e:8c:f8:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:39Z', 'updated_at': '2021-06-01T06:11:57Z', 'revision_number': 5, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'subnets': [{'id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:37.546527 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39936) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:37.548632 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6089426-b4f9-47f3-8e95-2d689c56926b None None] Checking router: b7bdc21e-592c-4bbf-87c9-5eba5676579e for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:18:37.555364 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-cc8d8ef6-bc67-4c52-8559-716f2b4b93d3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8087120', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1981457', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2134750'] for subnet, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:37.557900 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6089426-b4f9-47f3-8e95-2d689c56926b None None] Routers {'b7bdc21e-592c-4bbf-87c9-5eba5676579e'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:18:37.558524 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-d6089426-b4f9-47f3-8e95-2d689c56926b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b288ef70>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:18:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:37.561897 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-4e17cb9c-e582-40ae-9442-e26752f66dce admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:37.602385 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc8d8ef6-bc67-4c52-8559-716f2b4b93d3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1fbcd64f-1378-4ec3-bd16-df65964c6028,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:37.605760 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-cc8d8ef6-bc67-4c52-8559-716f2b4b93d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:37.606884 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-cc8d8ef6-bc67-4c52-8559-716f2b4b93d3 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:37.613148 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-cc8d8ef6-bc67-4c52-8559-716f2b4b93d3 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/1fbcd64f-1378-4ec3-bd16-df65964c6028 HTTP/1.1" status: 204  len: 168 time: 0.8562546
Jun 01 06:18:37.615664 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39940) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:37.622412 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17520f11-3548-4b64-87f6-0a1a2d5f776a None None] Network 6200246e-b324-4384-a0a9-6dc6726e2c6d requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:18:37.736862 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0cf7f2d6-a84f-4f48-8a33-ba20c04d4783 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:37.742303 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8063377'] for network, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:37.776792 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0cf7f2d6-a84f-4f48-8a33-ba20c04d4783 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:37.871729 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] Deleting port fe3b640e-c667-450d-ad4a-598acde8045a {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:18:37.871999 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:37.899631 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0cf7f2d6-a84f-4f48-8a33-ba20c04d4783 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:37.906950 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-9564971d-18c3-42f2-bea1-5140ec1b48aa tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:37.918733 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-d6089426-b4f9-47f3-8e95-2d689c56926b None None] Set router b7bdc21e-592c-4bbf-87c9-5eba5676579e gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:18:38.088409 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cf7f2d6-a84f-4f48-8a33-ba20c04d4783 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=82c902b9-bc90-4df0-adf7-1e67365c9650,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:38.093030 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-0cf7f2d6-a84f-4f48-8a33-ba20c04d4783 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:38.112800 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0cf7f2d6-a84f-4f48-8a33-ba20c04d4783 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:38.113906 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-0cf7f2d6-a84f-4f48-8a33-ba20c04d4783 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "DELETE /v2.0/security-groups/82c902b9-bc90-4df0-adf7-1e67365c9650 HTTP/1.1" status: 204  len: 168 time: 0.5663791
Jun 01 06:18:38.116979 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 39946) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:38.122198 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] For port fe3b640e-c667-450d-ad4a-598acde8045a, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=fe3b640e-c667-450d-ad4a-598acde8045a,segment=NetworkSegment(fd926c6b-9e42-4104-afe3-51ec344ecdd5),segment_id=fd926c6b-9e42-4104-afe3-51ec344ecdd5)] {{(pid=92230) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:18:38.126405 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:38.143268 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.api.v2.resource [None req-7eaab4c2-8c91-4bf7-960c-049031d04d0a tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] show failed (client error): The resource could not be found.
Jun 01 06:18:38.144591 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-7eaab4c2-8c91-4bf7-960c-049031d04d0a tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "GET /v2.0/security-groups/82c902b9-bc90-4df0-adf7-1e67365c9650 HTTP/1.1" status: 404  len: 347 time: 0.0264449
Jun 01 06:18:38.147812 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 39950) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:38.236813 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 2ff74456-d8aa-477a-a634-aca56832439b no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:18:38.261416 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] Calling delete_port for fe3b640e-c667-450d-ad4a-598acde8045a owned by network:dhcp {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:18:38.284778 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f9e10580-73c5-4f4d-89ef-7ba85e9c2254 None None] DHCP port deletion for 6200246e-b324-4384-a0a9-6dc6726e2c6d request from dv-cinder-793885-1-iscsi {{(pid=92231) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 06:18:38.289743 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: 2ff74456-d8aa-477a-a634-aca56832439b {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:18:38.290360 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 2ff74456-d8aa-477a-a634-aca56832439b not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:18:38.316985 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:38.320985 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-dc1db8ad-5eea-4595-bce6-bde9c33fc197 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:38.362290 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-f9e10580-73c5-4f4d-89ef-7ba85e9c2254 None None] The port 'fe3b640e-c667-450d-ad4a-598acde8045a' was deleted {{(pid=92231) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1919}}
Jun 01 06:18:38.372299 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] Pushing event deleted for resources: {'Port': ['ID=fe3b640e-c667-450d-ad4a-598acde8045a,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:38.376416 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:38.378829 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] No DVR routers for this DVR port fe3b640e-c667-450d-ad4a-598acde8045a on host dv-cinder-793885-1-iscsi {{(pid=92230) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:18:38.425154 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-07303e09-4a8f-4813-ba22-e03bc7e19ce6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:38.425478 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [None req-b796b785-ed64-47b9-98bf-928c0385bd8a tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Deleting port c6ee43ad-9301-414a-a6c7-ce69d97f565b {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:18:38.425960 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b796b785-ed64-47b9-98bf-928c0385bd8a tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:38.507467 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8093290', 'neutron.services.segments.db._delete_segments_for_network-8788497006300'] for network, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:38.527916 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe3b337f400>,) {'filters': {'network_id': ['6200246e-b324-4384-a0a9-6dc6726e2c6d']}} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:38.545645 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b337f400>, 'fd926c6b-9e42-4104-afe3-51ec344ecdd5') {'for_net_delete': True} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:38.545944 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b337f400>, 'fd926c6b-9e42-4104-afe3-51ec344ecdd5') {} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:38.554309 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-d6089426-b4f9-47f3-8e95-2d689c56926b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b288ef70>, [{'id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'name': 'tempest-AttachVolumeShelveTestJSON-921884409-router', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20'}], 'enable_snat': True}, 'gw_port_id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:24Z', 'updated_at': '2021-06-01T06:11:44Z', 'revision_number': 4, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'gw_port': {'id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:b4:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:27Z', 'updated_at': '2021-06-01T06:11:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '47f62b29-867e-4af1-9330-02c97cb95473', 'name': '', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'mac_address': 'fa:16:3e:8c:f8:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:39Z', 'updated_at': '2021-06-01T06:11:57Z', 'revision_number': 5, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'subnets': [{'id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:38.559324 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6089426-b4f9-47f3-8e95-2d689c56926b None None] The sync data for ids ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'] in dv-cinder-793885-1-iscsi is: [{'id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'name': 'tempest-AttachVolumeShelveTestJSON-921884409-router', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20'}], 'enable_snat': True}, 'gw_port_id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:24Z', 'updated_at': '2021-06-01T06:11:44Z', 'revision_number': 4, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'gw_port': {'id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:b4:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:27Z', 'updated_at': '2021-06-01T06:11:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': '47f62b29-867e-4af1-9330-02c97cb95473', 'name': '', 'network_id': '5f973ed4-521b-4b78-9a54-1336b1302fa2', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'mac_address': 'fa:16:3e:8c:f8:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:39Z', 'updated_at': '2021-06-01T06:11:57Z', 'revision_number': 5, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'subnets': [{'id': '6137ee10-ce13-45c9-8edb-31811502bfd7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:18:38.559708 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8788497014941', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2178892'] for segment, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:38.569899 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b796b785-ed64-47b9-98bf-928c0385bd8a tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:38.569899 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b796b785-ed64-47b9-98bf-928c0385bd8a tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:38.589557 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:38.600455 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] Releasing vlan 222 on physical network physnet1 to pool {{(pid=92230) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 06:18:38.600898 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2416152'] for segment, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]: Traceback (most recent call last):
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:     timer()
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:     cb(*args, **kw)
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:     return func(*args, **kwargs)
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:     self._notify()
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:     self.callback(batched_events)
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:     event.method(event)
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:     return f(self, *a, **k)
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self._get(url).json()
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self.request(url, 'GET', **kwargs)
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 06:18:38.618108 dv-cinder-793885-1-iscsi neutron-server[92230]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 06:18:38.720934 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8093283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-745674'] for network, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:38.724810 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:38.739564 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [None req-b796b785-ed64-47b9-98bf-928c0385bd8a tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Calling delete_port for c6ee43ad-9301-414a-a6c7-ce69d97f565b owned by network:floatingip {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:18:38.745754 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:38.748403 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] Pushing event deleted for resources: {'Network': ['ID=6200246e-b324-4384-a0a9-6dc6726e2c6d,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:38.751393 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:38.771988 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] 10.222.0.25 "DELETE /v2.0/networks/6200246e-b324-4384-a0a9-6dc6726e2c6d HTTP/1.1" status: 204  len: 168 time: 1.1542311
Jun 01 06:18:38.773914 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39954) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:38.870807 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b796b785-ed64-47b9-98bf-928c0385bd8a tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:38.876351 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-337346e4-8cd5-4b1d-bd39-a9973fa29751 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:38.897790 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ddfaa80-3065-4da3-9c7c-4ea12ab89f26 None None] New status for floating IP 1295facd-b7bb-4e57-99f6-ffed145c70db: DOWN {{(pid=92232) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 06:18:38.924137 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b796b785-ed64-47b9-98bf-928c0385bd8a tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Pushing event deleted for resources: {'Port': ['ID=c6ee43ad-9301-414a-a6c7-ce69d97f565b,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:38.954733 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b796b785-ed64-47b9-98bf-928c0385bd8a tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:39.026003 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b796b785-ed64-47b9-98bf-928c0385bd8a tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks [] for floatingip, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:39.040590 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-b796b785-ed64-47b9-98bf-928c0385bd8a tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for floatingip, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:39.041767 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-b796b785-ed64-47b9-98bf-928c0385bd8a tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] 10.222.0.25 "DELETE /v2.0/floatingips/1295facd-b7bb-4e57-99f6-ffed145c70db HTTP/1.1" status: 204  len: 168 time: 0.8930047
Jun 01 06:18:39.075554 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:18:39.118206 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] No Port match for: 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:18:39.118639 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 3a7e88d5-0834-4e15-acbc-90cd1b9bca61 not bound to the agent host hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:18:39.396025 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-98e5b0d3-6ce9-495c-90be-8d635e810db5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-744138'] for router_interface, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:39.919415 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-98e5b0d3-6ce9-495c-90be-8d635e810db5 admin admin] Deleting port a75c6cfb-ca4a-4dc4-981a-b8362697c093 {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:18:39.920157 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-98e5b0d3-6ce9-495c-90be-8d635e810db5 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:40.049678 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [None req-98e5b0d3-6ce9-495c-90be-8d635e810db5 admin admin] For port a75c6cfb-ca4a-4dc4-981a-b8362697c093, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=a75c6cfb-ca4a-4dc4-981a-b8362697c093,segment=NetworkSegment(3df30a41-b01e-4383-92a4-8350393bd930),segment_id=3df30a41-b01e-4383-92a4-8350393bd930)] {{(pid=92230) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:18:40.050098 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-98e5b0d3-6ce9-495c-90be-8d635e810db5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:40.187378 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-98e5b0d3-6ce9-495c-90be-8d635e810db5 admin admin] Calling delete_port for a75c6cfb-ca4a-4dc4-981a-b8362697c093 owned by network:router_interface {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:18:40.239243 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device fe3b640e-c667-450d-ad4a-598acde8045a no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:18:40.284881 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: fe3b640e-c667-450d-ad4a-598acde8045a {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:18:40.285229 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device fe3b640e-c667-450d-ad4a-598acde8045a not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:18:40.366568 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-98e5b0d3-6ce9-495c-90be-8d635e810db5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:40.370821 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-492d1522-2a01-4700-918f-ae25109229d3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:40.417776 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98e5b0d3-6ce9-495c-90be-8d635e810db5 admin admin] Pushing event deleted for resources: {'Port': ['ID=a75c6cfb-ca4a-4dc4-981a-b8362697c093,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:40.457122 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-98e5b0d3-6ce9-495c-90be-8d635e810db5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:40.714233 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-98e5b0d3-6ce9-495c-90be-8d635e810db5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-581113', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-746586'] for router_interface, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:41.083707 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-98e5b0d3-6ce9-495c-90be-8d635e810db5 admin admin] Router 1332a475-4493-4edf-9b3e-9cabb6f0ef57 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92230) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:18:41.231296 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:41.383220 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-98e5b0d3-6ce9-495c-90be-8d635e810db5 admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:18:41.391718 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87d66335-b960-4e40-8d4d-acce90a7b4d8 None None] Sync routers for ids ['1332a475-4493-4edf-9b3e-9cabb6f0ef57'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:18:41.392429 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-98e5b0d3-6ce9-495c-90be-8d635e810db5 admin admin] 10.222.0.25 "PUT /v2.0/routers/1332a475-4493-4edf-9b3e-9cabb6f0ef57/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6175311
Jun 01 06:18:41.394981 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39978) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:41.401349 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87d66335-b960-4e40-8d4d-acce90a7b4d8 None None] Routers {'1332a475-4493-4edf-9b3e-9cabb6f0ef57'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:18:41.402065 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-87d66335-b960-4e40-8d4d-acce90a7b4d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2270c40>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:18:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['1332a475-4493-4edf-9b3e-9cabb6f0ef57'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:41.582270 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-77bf7ec8-34cd-41e8-849e-7fdc7fd0c2dd admin admin] Notify callbacks [] for router, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:41.586318 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-87d66335-b960-4e40-8d4d-acce90a7b4d8 None None] Set router 1332a475-4493-4edf-9b3e-9cabb6f0ef57 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:18:41.774753 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-77bf7ec8-34cd-41e8-849e-7fdc7fd0c2dd admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:41.859341 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-77bf7ec8-34cd-41e8-849e-7fdc7fd0c2dd admin admin] Deleting port 962c60b2-2fe3-4cde-a7fb-73010b6c5779 {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:18:41.859669 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-77bf7ec8-34cd-41e8-849e-7fdc7fd0c2dd admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:41.886927 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 39988) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:41.890789 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-87d66335-b960-4e40-8d4d-acce90a7b4d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2270c40>, [{'id': '1332a475-4493-4edf-9b3e-9cabb6f0ef57', 'name': 'tempest-TestShelveInstance-2060600636-router', 'tenant_id': 'ba7789f528bf4befb68a21f4c2498c04', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.18'}], 'enable_snat': True}, 'gw_port_id': '962c60b2-2fe3-4cde-a7fb-73010b6c5779', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:16Z', 'updated_at': '2021-06-01T06:18:40Z', 'revision_number': 5, 'project_id': 'ba7789f528bf4befb68a21f4c2498c04', 'gw_port': {'id': '962c60b2-2fe3-4cde-a7fb-73010b6c5779', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:f2:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1332a475-4493-4edf-9b3e-9cabb6f0ef57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 340, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.18', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:41.895467 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87d66335-b960-4e40-8d4d-acce90a7b4d8 None None] Checking router: 1332a475-4493-4edf-9b3e-9cabb6f0ef57 for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:18:41.905926 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87d66335-b960-4e40-8d4d-acce90a7b4d8 None None] Routers {'1332a475-4493-4edf-9b3e-9cabb6f0ef57'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:18:41.906674 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-87d66335-b960-4e40-8d4d-acce90a7b4d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2270c40>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:18:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['1332a475-4493-4edf-9b3e-9cabb6f0ef57'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:42.024505 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [None req-77bf7ec8-34cd-41e8-849e-7fdc7fd0c2dd admin admin] For port 962c60b2-2fe3-4cde-a7fb-73010b6c5779, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=962c60b2-2fe3-4cde-a7fb-73010b6c5779,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92230) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:18:42.025372 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-77bf7ec8-34cd-41e8-849e-7fdc7fd0c2dd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:42.079448 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-87d66335-b960-4e40-8d4d-acce90a7b4d8 None None] Set router 1332a475-4493-4edf-9b3e-9cabb6f0ef57 gateway port host: None {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:18:42.162054 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-77bf7ec8-34cd-41e8-849e-7fdc7fd0c2dd admin admin] Calling delete_port for 962c60b2-2fe3-4cde-a7fb-73010b6c5779 owned by network:router_gateway {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:18:42.212176 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-87d66335-b960-4e40-8d4d-acce90a7b4d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2270c40>, [{'id': '1332a475-4493-4edf-9b3e-9cabb6f0ef57', 'name': 'tempest-TestShelveInstance-2060600636-router', 'tenant_id': 'ba7789f528bf4befb68a21f4c2498c04', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:16Z', 'updated_at': '2021-06-01T06:18:41Z', 'revision_number': 6, 'project_id': 'ba7789f528bf4befb68a21f4c2498c04', 'gw_port_host': None}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:42.223055 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87d66335-b960-4e40-8d4d-acce90a7b4d8 None None] The sync data for ids ['1332a475-4493-4edf-9b3e-9cabb6f0ef57'] in dv-cinder-793885-1-iscsi is: [{'id': '1332a475-4493-4edf-9b3e-9cabb6f0ef57', 'name': 'tempest-TestShelveInstance-2060600636-router', 'tenant_id': 'ba7789f528bf4befb68a21f4c2498c04', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:16Z', 'updated_at': '2021-06-01T06:18:41Z', 'revision_number': 6, 'project_id': 'ba7789f528bf4befb68a21f4c2498c04', 'gw_port_host': None}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:18:42.343834 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-77bf7ec8-34cd-41e8-849e-7fdc7fd0c2dd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:42.349079 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-b0eb5084-3482-4d15-92fe-5f2f314fb572 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:42.353148 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-86c34207-55df-41b2-a795-7e22a6154f23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:42.396861 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77bf7ec8-34cd-41e8-849e-7fdc7fd0c2dd admin admin] Pushing event deleted for resources: {'Port': ['ID=962c60b2-2fe3-4cde-a7fb-73010b6c5779,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:42.431286 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-77bf7ec8-34cd-41e8-849e-7fdc7fd0c2dd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:42.496832 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-77bf7ec8-34cd-41e8-849e-7fdc7fd0c2dd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-745687'] for router_gateway, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:42.701945 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-77bf7ec8-34cd-41e8-849e-7fdc7fd0c2dd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-748122', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-727'] for router, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:42.704168 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-77bf7ec8-34cd-41e8-849e-7fdc7fd0c2dd admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:42.713108 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-fb12b084-cd95-4b4d-ae7b-a4e52e48b85a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-744138'] for router_interface, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:42.728208 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-77bf7ec8-34cd-41e8-849e-7fdc7fd0c2dd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-746854'] for router, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:42.728862 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-77bf7ec8-34cd-41e8-849e-7fdc7fd0c2dd admin admin] Fanout notify agent at l3_agent the message router_deleted on router 1332a475-4493-4edf-9b3e-9cabb6f0ef57 {{(pid=92230) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 06:18:42.741964 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-77bf7ec8-34cd-41e8-849e-7fdc7fd0c2dd admin admin] Notify callbacks [] for router, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:42.746264 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-77bf7ec8-34cd-41e8-849e-7fdc7fd0c2dd admin admin] 10.222.0.25 "DELETE /v2.0/routers/1332a475-4493-4edf-9b3e-9cabb6f0ef57 HTTP/1.1" status: 204  len: 168 time: 1.3472152
Jun 01 06:18:42.746518 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 39996) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:42.808725 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_v2 [None req-eb261d4b-d610-4b52-8040-53970a543535 admin admin] Deleting subnet 8fbe5513-cda8-4cd9-b261-e9e9b9a9609f {{(pid=92230) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 06:18:42.812079 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-eb261d4b-d610-4b52-8040-53970a543535 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:42.976800 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-eb261d4b-d610-4b52-8040-53970a543535 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2178887'] for subnet, precommit_delete_associations {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:43.107603 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-eb261d4b-d610-4b52-8040-53970a543535 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8086245'] for subnet, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:43.162813 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [None req-fb12b084-cd95-4b4d-ae7b-a4e52e48b85a admin admin] Deleting port 47f62b29-867e-4af1-9330-02c97cb95473 {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:18:43.163409 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-fb12b084-cd95-4b4d-ae7b-a4e52e48b85a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:43.279924 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:43.300314 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [None req-fb12b084-cd95-4b4d-ae7b-a4e52e48b85a admin admin] For port 47f62b29-867e-4af1-9330-02c97cb95473, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=47f62b29-867e-4af1-9330-02c97cb95473,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:18:43.300804 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-fb12b084-cd95-4b4d-ae7b-a4e52e48b85a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:43.396273 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-eb261d4b-d610-4b52-8040-53970a543535 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8087120', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2445502', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1981527'] for subnet, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:43.402094 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-c1734292-eeb1-4fe3-8274-b00774aaa5be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:43.440707 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [None req-fb12b084-cd95-4b4d-ae7b-a4e52e48b85a admin admin] Calling delete_port for 47f62b29-867e-4af1-9330-02c97cb95473 owned by network:router_interface {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:18:43.442121 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb261d4b-d610-4b52-8040-53970a543535 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8fbe5513-cda8-4cd9-b261-e9e9b9a9609f,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:43.445497 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-eb261d4b-d610-4b52-8040-53970a543535 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:43.446486 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-eb261d4b-d610-4b52-8040-53970a543535 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:43.455019 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a70465ef-414a-4a81-8bbe-5e6e18263496 None None] Network 95697b5d-7f1d-4bab-b484-9d0f188c19b6 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:18:43.462288 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 40010) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:43.464115 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-eb261d4b-d610-4b52-8040-53970a543535 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/8fbe5513-cda8-4cd9-b261-e9e9b9a9609f HTTP/1.1" status: 204  len: 168 time: 0.7054446
Jun 01 06:18:43.583671 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8063377'] for network, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:43.772736 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6c3e0549-3180-4414-85ea-6c619b0a2dfb None None] DHCP port deletion for 95697b5d-7f1d-4bab-b484-9d0f188c19b6 request from dv-cinder-793885-1-iscsi {{(pid=92231) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 06:18:43.836844 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] Deleting port 4ba492f1-8627-418b-b6d8-63900e8f34eb {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:18:43.837185 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:43.839302 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-6c3e0549-3180-4414-85ea-6c619b0a2dfb None None] Deleting port 4ba492f1-8627-418b-b6d8-63900e8f34eb {{(pid=92231) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:18:43.839743 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-6c3e0549-3180-4414-85ea-6c619b0a2dfb None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:43.943811 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-6c3e0549-3180-4414-85ea-6c619b0a2dfb None None] For port 4ba492f1-8627-418b-b6d8-63900e8f34eb, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=4ba492f1-8627-418b-b6d8-63900e8f34eb,segment=NetworkSegment(3df30a41-b01e-4383-92a4-8350393bd930),segment_id=3df30a41-b01e-4383-92a4-8350393bd930)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:18:43.944217 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-6c3e0549-3180-4414-85ea-6c619b0a2dfb None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:44.070529 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-6c3e0549-3180-4414-85ea-6c619b0a2dfb None None] Calling delete_port for 4ba492f1-8627-418b-b6d8-63900e8f34eb owned by network:dhcp {{(pid=92231) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:18:44.094175 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] For port 4ba492f1-8627-418b-b6d8-63900e8f34eb, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=4ba492f1-8627-418b-b6d8-63900e8f34eb,segment=NetworkSegment(3df30a41-b01e-4383-92a4-8350393bd930),segment_id=3df30a41-b01e-4383-92a4-8350393bd930)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:18:44.094529 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:44.120095 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-6c3e0549-3180-4414-85ea-6c619b0a2dfb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756'] for port, after_delete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:44.124840 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:44.158016 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-fb12b084-cd95-4b4d-ae7b-a4e52e48b85a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:44.176455 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c3e0549-3180-4414-85ea-6c619b0a2dfb None None] Pushing event deleted for resources: {'Port': ['ID=4ba492f1-8627-418b-b6d8-63900e8f34eb,revision_number=None']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:44.188624 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c3e0549-3180-4414-85ea-6c619b0a2dfb None None] No DVR routers for this DVR port 4ba492f1-8627-418b-b6d8-63900e8f34eb on host dv-cinder-793885-1-iscsi {{(pid=92231) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:18:44.194401 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c3e0549-3180-4414-85ea-6c619b0a2dfb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:44.194749 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c3e0549-3180-4414-85ea-6c619b0a2dfb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:44.195144 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c3e0549-3180-4414-85ea-6c619b0a2dfb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:44.195402 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c3e0549-3180-4414-85ea-6c619b0a2dfb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:44.195727 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c3e0549-3180-4414-85ea-6c619b0a2dfb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:44.196106 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c3e0549-3180-4414-85ea-6c619b0a2dfb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:44.196527 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c3e0549-3180-4414-85ea-6c619b0a2dfb None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:44.196739 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c3e0549-3180-4414-85ea-6c619b0a2dfb None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:44.197060 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c3e0549-3180-4414-85ea-6c619b0a2dfb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:44.197432 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c3e0549-3180-4414-85ea-6c619b0a2dfb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:44.197940 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c3e0549-3180-4414-85ea-6c619b0a2dfb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:44.198481 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c3e0549-3180-4414-85ea-6c619b0a2dfb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:44.205324 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-6c3e0549-3180-4414-85ea-6c619b0a2dfb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:44.229180 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-de44d280-e4de-4fbb-8745-b885f27b0c22 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:44.246648 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device a75c6cfb-ca4a-4dc4-981a-b8362697c093 no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:18:44.273620 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] Calling delete_port for 4ba492f1-8627-418b-b6d8-63900e8f34eb owned by network:dhcp {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:18:44.283465 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: a75c6cfb-ca4a-4dc4-981a-b8362697c093 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:18:44.284028 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device a75c6cfb-ca4a-4dc4-981a-b8362697c093 not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:18:44.284657 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 962c60b2-2fe3-4cde-a7fb-73010b6c5779 no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:18:44.315885 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb12b084-cd95-4b4d-ae7b-a4e52e48b85a admin admin] Pushing event deleted for resources: {'Port': ['ID=47f62b29-867e-4af1-9330-02c97cb95473,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:44.324079 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-fb12b084-cd95-4b4d-ae7b-a4e52e48b85a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:44.334028 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: 962c60b2-2fe3-4cde-a7fb-73010b6c5779 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:18:44.334461 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 962c60b2-2fe3-4cde-a7fb-73010b6c5779 not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:18:44.334948 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 4ba492f1-8627-418b-b6d8-63900e8f34eb no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:18:44.373141 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: 4ba492f1-8627-418b-b6d8-63900e8f34eb {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:18:44.373567 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 4ba492f1-8627-418b-b6d8-63900e8f34eb not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:18:44.575736 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:44.581485 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-fb12b084-cd95-4b4d-ae7b-a4e52e48b85a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:44.612249 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-fb12b084-cd95-4b4d-ae7b-a4e52e48b85a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-581113', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-746586'] for router_interface, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:44.636209 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] No DVR routers for this DVR port 4ba492f1-8627-418b-b6d8-63900e8f34eb on host dv-cinder-793885-1-iscsi {{(pid=92229) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:18:44.638933 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] Pushing event deleted for resources: {'Port': ['ID=4ba492f1-8627-418b-b6d8-63900e8f34eb,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:44.780263 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.199s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:44.904131 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8093290', 'neutron.services.segments.db._delete_segments_for_network-8788497006300'] for network, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:44.927450 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe3b10a70d0>,) {'filters': {'network_id': ['95697b5d-7f1d-4bab-b484-9d0f188c19b6']}} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:44.944557 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b10a70d0>, '3df30a41-b01e-4383-92a4-8350393bd930') {'for_net_delete': True} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:44.944848 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b10a70d0>, '3df30a41-b01e-4383-92a4-8350393bd930') {} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:44.961903 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8788497014941', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2127091'] for segment, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:45.030227 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:45.049336 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] Releasing vlan 212 on physical network physnet1 to pool {{(pid=92229) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 06:18:45.049714 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2077367'] for segment, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]: Traceback (most recent call last):
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:     timer()
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:     cb(*args, **kw)
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:     return func(*args, **kwargs)
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:     self._notify()
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:     self.callback(batched_events)
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:     event.method(event)
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:     return f(self, *a, **k)
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self._get(url).json()
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self.request(url, 'GET', **kwargs)
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 06:18:45.063330 dv-cinder-793885-1-iscsi neutron-server[92229]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 06:18:45.216776 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8093283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-745674'] for network, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:45.227744 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:45.243347 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:45.258757 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] Pushing event deleted for resources: {'Network': ['ID=95697b5d-7f1d-4bab-b484-9d0f188c19b6,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:45.271859 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:45.274432 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] 10.222.0.25 "DELETE /v2.0/networks/95697b5d-7f1d-4bab-b484-9d0f188c19b6 HTTP/1.1" status: 204  len: 168 time: 1.8106549
Jun 01 06:18:45.279841 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fb12b084-cd95-4b4d-ae7b-a4e52e48b85a admin admin] Router b7bdc21e-592c-4bbf-87c9-5eba5676579e has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92229) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:18:45.379651 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:45.397928 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 40026) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:45.454480 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-e93bc45b-03fc-4530-86ca-7c82ef7e466a admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=60be617f683c42a081ab3f50c3bdf8f1&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0552337
Jun 01 06:18:45.456951 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 40030) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:45.520021 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9f214f95-8b12-41aa-9c75-9c1e3d956f31 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:45.548703 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9f214f95-8b12-41aa-9c75-9c1e3d956f31 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:45.590964 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fb12b084-cd95-4b4d-ae7b-a4e52e48b85a admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92229) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:18:45.597393 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-fb12b084-cd95-4b4d-ae7b-a4e52e48b85a admin admin] 10.222.0.25 "PUT /v2.0/routers/b7bdc21e-592c-4bbf-87c9-5eba5676579e/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 3.7089891
Jun 01 06:18:45.600352 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 40034) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:45.605417 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abad6943-5f57-49d6-9d46-81f09adf9855 None None] Sync routers for ids ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'] in dv-cinder-793885-1-iscsi {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:18:45.614974 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-abad6943-5f57-49d6-9d46-81f09adf9855 None None] Routers {'b7bdc21e-592c-4bbf-87c9-5eba5676579e'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:18:45.615712 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-abad6943-5f57-49d6-9d46-81f09adf9855 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b26a9280>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:18:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:45.668749 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9f214f95-8b12-41aa-9c75-9c1e3d956f31 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:45.678659 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-ef5c124e-fb9b-446c-8665-bd0cce163713 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:45.702088 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f214f95-8b12-41aa-9c75-9c1e3d956f31 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3a46a24c-7372-4850-873a-8fec66fda8c2,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:45.704473 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-9f214f95-8b12-41aa-9c75-9c1e3d956f31 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:45.722936 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9f214f95-8b12-41aa-9c75-9c1e3d956f31 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:45.734355 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-9f214f95-8b12-41aa-9c75-9c1e3d956f31 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/3a46a24c-7372-4850-873a-8fec66fda8c2 HTTP/1.1" status: 204  len: 168 time: 0.2761819
Jun 01 06:18:45.819710 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-abad6943-5f57-49d6-9d46-81f09adf9855 None None] Set router b7bdc21e-592c-4bbf-87c9-5eba5676579e gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:18:45.838383 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ca68a267-3a4b-4df0-8458-0a2bc5d1c2d5 admin admin] Notify callbacks [] for router, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:46.008440 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:46.028876 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ca68a267-3a4b-4df0-8458-0a2bc5d1c2d5 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:46.103087 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-ca68a267-3a4b-4df0-8458-0a2bc5d1c2d5 admin admin] Deleting port 15dfae58-2fa8-4151-bc0e-796ec182e152 {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:18:46.104045 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ca68a267-3a4b-4df0-8458-0a2bc5d1c2d5 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:46.123124 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 40044) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:46.127926 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-abad6943-5f57-49d6-9d46-81f09adf9855 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b26a9280>, [{'id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'name': 'tempest-AttachVolumeShelveTestJSON-921884409-router', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20'}], 'enable_snat': True}, 'gw_port_id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:24Z', 'updated_at': '2021-06-01T06:18:43Z', 'revision_number': 5, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'gw_port': {'id': '15dfae58-2fa8-4151-bc0e-796ec182e152', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:b4:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:11:27Z', 'updated_at': '2021-06-01T06:11:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:46.131966 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abad6943-5f57-49d6-9d46-81f09adf9855 None None] Checking router: b7bdc21e-592c-4bbf-87c9-5eba5676579e for host: dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:18:46.141273 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-abad6943-5f57-49d6-9d46-81f09adf9855 None None] Routers {'b7bdc21e-592c-4bbf-87c9-5eba5676579e'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:18:46.141883 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-abad6943-5f57-49d6-9d46-81f09adf9855 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b26a9280>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:18:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:46.177155 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-a2169706-4cd6-4e92-8858-395e3dbdd345 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=ba7789f528bf4befb68a21f4c2498c04&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0505629
Jun 01 06:18:46.177509 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 40048) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:46.258031 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [None req-ca68a267-3a4b-4df0-8458-0a2bc5d1c2d5 admin admin] For port 15dfae58-2fa8-4151-bc0e-796ec182e152, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=15dfae58-2fa8-4151-bc0e-796ec182e152,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92230) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:18:46.258855 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ca68a267-3a4b-4df0-8458-0a2bc5d1c2d5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:46.260043 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-1631709f-ca9c-46c3-b1a9-efeb6305f954 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:46.289721 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-1631709f-ca9c-46c3-b1a9-efeb6305f954 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:46.322562 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-abad6943-5f57-49d6-9d46-81f09adf9855 None None] Set router b7bdc21e-592c-4bbf-87c9-5eba5676579e gateway port host: None {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:18:46.351110 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-1631709f-ca9c-46c3-b1a9-efeb6305f954 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:46.356202 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-64aefdf1-93b7-46c8-99bc-e833903896f4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:46.367934 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1631709f-ca9c-46c3-b1a9-efeb6305f954 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9b08ea87-bef9-46b1-b92d-ba5ca569465b,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:46.371405 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-1631709f-ca9c-46c3-b1a9-efeb6305f954 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:46.377438 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-1631709f-ca9c-46c3-b1a9-efeb6305f954 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:46.381672 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-1631709f-ca9c-46c3-b1a9-efeb6305f954 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/9b08ea87-bef9-46b1-b92d-ba5ca569465b HTTP/1.1" status: 204  len: 168 time: 0.2031064
Jun 01 06:18:46.431543 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-ca68a267-3a4b-4df0-8458-0a2bc5d1c2d5 admin admin] Calling delete_port for 15dfae58-2fa8-4151-bc0e-796ec182e152 owned by network:router_gateway {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:18:46.433903 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-abad6943-5f57-49d6-9d46-81f09adf9855 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b26a9280>, [{'id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'name': 'tempest-AttachVolumeShelveTestJSON-921884409-router', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:24Z', 'updated_at': '2021-06-01T06:18:46Z', 'revision_number': 6, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'gw_port_host': None}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:46.438309 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abad6943-5f57-49d6-9d46-81f09adf9855 None None] The sync data for ids ['b7bdc21e-592c-4bbf-87c9-5eba5676579e'] in dv-cinder-793885-1-iscsi is: [{'id': 'b7bdc21e-592c-4bbf-87c9-5eba5676579e', 'name': 'tempest-AttachVolumeShelveTestJSON-921884409-router', 'tenant_id': '0f63ca6fed3e47a6a676979240aef5c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:11:24Z', 'updated_at': '2021-06-01T06:18:46Z', 'revision_number': 6, 'project_id': '0f63ca6fed3e47a6a676979240aef5c0', 'gw_port_host': None}] {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:18:46.584627 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ca68a267-3a4b-4df0-8458-0a2bc5d1c2d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:46.604531 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-77bf7ec8-34cd-41e8-849e-7fdc7fd0c2dd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:46.798193 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca68a267-3a4b-4df0-8458-0a2bc5d1c2d5 admin admin] Pushing event deleted for resources: {'Port': ['ID=15dfae58-2fa8-4151-bc0e-796ec182e152,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:46.800774 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-ca68a267-3a4b-4df0-8458-0a2bc5d1c2d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:46.857250 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ca68a267-3a4b-4df0-8458-0a2bc5d1c2d5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-745687'] for router_gateway, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:47.033937 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ca68a267-3a4b-4df0-8458-0a2bc5d1c2d5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-748122', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-727'] for router, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:47.036134 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ca68a267-3a4b-4df0-8458-0a2bc5d1c2d5 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:47.060535 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ca68a267-3a4b-4df0-8458-0a2bc5d1c2d5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-746854'] for router, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:47.061283 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ca68a267-3a4b-4df0-8458-0a2bc5d1c2d5 admin admin] Fanout notify agent at l3_agent the message router_deleted on router b7bdc21e-592c-4bbf-87c9-5eba5676579e {{(pid=92230) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 06:18:47.074232 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-ca68a267-3a4b-4df0-8458-0a2bc5d1c2d5 admin admin] Notify callbacks [] for router, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:47.075393 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-ca68a267-3a4b-4df0-8458-0a2bc5d1c2d5 admin admin] 10.222.0.25 "DELETE /v2.0/routers/b7bdc21e-592c-4bbf-87c9-5eba5676579e HTTP/1.1" status: 204  len: 168 time: 1.4738300
Jun 01 06:18:47.077958 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 40056) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:47.136869 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_v2 [None req-a9a802d2-05c6-4887-90bc-cfa151236923 admin admin] Deleting subnet 6137ee10-ce13-45c9-8edb-31811502bfd7 {{(pid=92230) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 06:18:47.139624 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a9a802d2-05c6-4887-90bc-cfa151236923 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:47.191411 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a9a802d2-05c6-4887-90bc-cfa151236923 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2178887'] for subnet, precommit_delete_associations {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:47.277003 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a9a802d2-05c6-4887-90bc-cfa151236923 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8086245'] for subnet, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:47.534847 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a9a802d2-05c6-4887-90bc-cfa151236923 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8087120', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2445502', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1981527'] for subnet, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:47.538694 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-eb261d4b-d610-4b52-8040-53970a543535 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:47.579400 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9a802d2-05c6-4887-90bc-cfa151236923 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6137ee10-ce13-45c9-8edb-31811502bfd7,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:47.582708 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-a9a802d2-05c6-4887-90bc-cfa151236923 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:47.583691 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a9a802d2-05c6-4887-90bc-cfa151236923 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:47.591097 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fffd2c3f-56ac-460c-9d92-f11f42fecb17 None None] Network 5f973ed4-521b-4b78-9a54-1336b1302fa2 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:18:47.592093 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-a9a802d2-05c6-4887-90bc-cfa151236923 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/6137ee10-ce13-45c9-8edb-31811502bfd7 HTTP/1.1" status: 204  len: 168 time: 0.5122089
Jun 01 06:18:47.593936 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 40060) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:47.707822 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d1944c65-0859-4975-9a77-7c3d876c4516 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8063377'] for network, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:47.780420 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-d1944c65-0859-4975-9a77-7c3d876c4516 admin admin] Deleting port 2307044b-54df-426e-9c5e-a4b02e59aecc {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:18:47.780643 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d1944c65-0859-4975-9a77-7c3d876c4516 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:47.851468 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-25109d61-5fe4-4e3c-81b2-fc0f84aadfb0 None None] DHCP port deletion for 5f973ed4-521b-4b78-9a54-1336b1302fa2 request from dv-cinder-793885-1-iscsi {{(pid=92231) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 06:18:47.881926 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [None req-d1944c65-0859-4975-9a77-7c3d876c4516 admin admin] For port 2307044b-54df-426e-9c5e-a4b02e59aecc, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=2307044b-54df-426e-9c5e-a4b02e59aecc,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92230) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:18:47.882268 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d1944c65-0859-4975-9a77-7c3d876c4516 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:47.921775 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-25109d61-5fe4-4e3c-81b2-fc0f84aadfb0 None None] Deleting port 2307044b-54df-426e-9c5e-a4b02e59aecc {{(pid=92231) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:18:47.922067 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-25109d61-5fe4-4e3c-81b2-fc0f84aadfb0 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:48.014730 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-d1944c65-0859-4975-9a77-7c3d876c4516 admin admin] Calling delete_port for 2307044b-54df-426e-9c5e-a4b02e59aecc owned by network:dhcp {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:18:48.044926 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-25109d61-5fe4-4e3c-81b2-fc0f84aadfb0 None None] For port 2307044b-54df-426e-9c5e-a4b02e59aecc, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=2307044b-54df-426e-9c5e-a4b02e59aecc,segment=NetworkSegment(79adeacf-7d8b-48ea-a63b-df4d7bfff135),segment_id=79adeacf-7d8b-48ea-a63b-df4d7bfff135)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:18:48.044926 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-25109d61-5fe4-4e3c-81b2-fc0f84aadfb0 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:48.074564 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d1944c65-0859-4975-9a77-7c3d876c4516 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:48.079611 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-41620860-1770-46ad-bdcd-4001ede98813 tempest-ServerRescueNegativeTestJSON-1643446657 tempest-ServerRescueNegativeTestJSON-1643446657-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:48.130211 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1944c65-0859-4975-9a77-7c3d876c4516 admin admin] No DVR routers for this DVR port 2307044b-54df-426e-9c5e-a4b02e59aecc on host dv-cinder-793885-1-iscsi {{(pid=92230) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:18:48.156305 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1944c65-0859-4975-9a77-7c3d876c4516 admin admin] Pushing event deleted for resources: {'Port': ['ID=2307044b-54df-426e-9c5e-a4b02e59aecc,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:48.158766 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-d1944c65-0859-4975-9a77-7c3d876c4516 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:48.164343 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-25109d61-5fe4-4e3c-81b2-fc0f84aadfb0 None None] Calling delete_port for 2307044b-54df-426e-9c5e-a4b02e59aecc owned by network:dhcp {{(pid=92231) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:18:48.213742 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-25109d61-5fe4-4e3c-81b2-fc0f84aadfb0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756'] for port, after_delete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:48.217535 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:48.268951 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25109d61-5fe4-4e3c-81b2-fc0f84aadfb0 None None] Pushing event deleted for resources: {'Port': ['ID=2307044b-54df-426e-9c5e-a4b02e59aecc,revision_number=None']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:48.271998 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-25109d61-5fe4-4e3c-81b2-fc0f84aadfb0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:48.272802 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25109d61-5fe4-4e3c-81b2-fc0f84aadfb0 None None] No DVR routers for this DVR port 2307044b-54df-426e-9c5e-a4b02e59aecc on host dv-cinder-793885-1-iscsi {{(pid=92231) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:18:48.314522 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 15dfae58-2fa8-4151-bc0e-796ec182e152 no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:18:48.356794 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: 15dfae58-2fa8-4151-bc0e-796ec182e152 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:18:48.357230 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 15dfae58-2fa8-4151-bc0e-796ec182e152 not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:18:48.357725 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 2307044b-54df-426e-9c5e-a4b02e59aecc no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:18:48.368216 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d1944c65-0859-4975-9a77-7c3d876c4516 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8093290', 'neutron.services.segments.db._delete_segments_for_network-8788497006300'] for network, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:48.381663 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-d1944c65-0859-4975-9a77-7c3d876c4516 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe3b1697700>,) {'filters': {'network_id': ['5f973ed4-521b-4b78-9a54-1336b1302fa2']}} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:48.391472 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: 2307044b-54df-426e-9c5e-a4b02e59aecc {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:18:48.391847 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 2307044b-54df-426e-9c5e-a4b02e59aecc not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:18:48.392275 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 47f62b29-867e-4af1-9330-02c97cb95473 no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:18:48.394783 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-d1944c65-0859-4975-9a77-7c3d876c4516 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b1697700>, '79adeacf-7d8b-48ea-a63b-df4d7bfff135') {'for_net_delete': True} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:48.395081 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-d1944c65-0859-4975-9a77-7c3d876c4516 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b1697700>, '79adeacf-7d8b-48ea-a63b-df4d7bfff135') {} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:48.407436 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d1944c65-0859-4975-9a77-7c3d876c4516 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8788497014941', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2178892'] for segment, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:48.424081 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d1944c65-0859-4975-9a77-7c3d876c4516 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:48.425826 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: 47f62b29-867e-4af1-9330-02c97cb95473 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:18:48.426176 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 47f62b29-867e-4af1-9330-02c97cb95473 not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:18:48.430173 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d1944c65-0859-4975-9a77-7c3d876c4516 admin admin] Releasing vlan 245 on physical network physnet1 to pool {{(pid=92230) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 06:18:48.430620 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d1944c65-0859-4975-9a77-7c3d876c4516 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2416152'] for segment, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]: Traceback (most recent call last):
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:     timer()
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:     cb(*args, **kw)
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:     return func(*args, **kwargs)
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:     self._notify()
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:     self.callback(batched_events)
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:     event.method(event)
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:     return f(self, *a, **k)
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self._get(url).json()
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self.request(url, 'GET', **kwargs)
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 06:18:48.444663 dv-cinder-793885-1-iscsi neutron-server[92230]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 06:18:48.522897 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d1944c65-0859-4975-9a77-7c3d876c4516 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8093283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-745674'] for network, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:48.526693 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:48.539630 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d1944c65-0859-4975-9a77-7c3d876c4516 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:48.550063 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1944c65-0859-4975-9a77-7c3d876c4516 admin admin] Pushing event deleted for resources: {'Network': ['ID=5f973ed4-521b-4b78-9a54-1336b1302fa2,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:48.553187 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-d1944c65-0859-4975-9a77-7c3d876c4516 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:48.564379 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-d1944c65-0859-4975-9a77-7c3d876c4516 admin admin] 10.222.0.25 "DELETE /v2.0/networks/5f973ed4-521b-4b78-9a54-1336b1302fa2 HTTP/1.1" status: 204  len: 168 time: 0.9694002
Jun 01 06:18:48.745010 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 40074) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:48.794514 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-37c874bb-a90f-45a2-bce0-6b4ae5bfe2f4 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=0f63ca6fed3e47a6a676979240aef5c0&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0477352
Jun 01 06:18:48.796864 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 40078) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:48.855694 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1c23dd94-7431-4f4f-98ca-49bd1b3be76a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:48.881703 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1c23dd94-7431-4f4f-98ca-49bd1b3be76a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:48.938132 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1c23dd94-7431-4f4f-98ca-49bd1b3be76a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:48.942020 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-9e1dc03f-bdd8-48cf-a8dd-50d36979a062 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:48.954171 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c23dd94-7431-4f4f-98ca-49bd1b3be76a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e9cbf362-dbd3-4a0d-86bb-db72aa28914e,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:48.956589 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-1c23dd94-7431-4f4f-98ca-49bd1b3be76a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:48.963993 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1c23dd94-7431-4f4f-98ca-49bd1b3be76a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:48.965440 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-1c23dd94-7431-4f4f-98ca-49bd1b3be76a admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/e9cbf362-dbd3-4a0d-86bb-db72aa28914e HTTP/1.1" status: 204  len: 168 time: 0.1673977
Jun 01 06:18:50.145557 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 40120) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:50.270867 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-9102eed3-f60c-4382-8aec-e95f5b186b4a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:50.286431 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-9102eed3-f60c-4382-8aec-e95f5b186b4a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:18:50.290228 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-9102eed3-f60c-4382-8aec-e95f5b186b4a admin admin] Usage tracker for resource:security_group_rule and tenant:d4a72c2333b44771834bf9b11d65d2ff is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:18:50.294052 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-9102eed3-f60c-4382-8aec-e95f5b186b4a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:18:50.299709 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-9102eed3-f60c-4382-8aec-e95f5b186b4a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:18:50.389778 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-9102eed3-f60c-4382-8aec-e95f5b186b4a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:50.393648 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-9102eed3-f60c-4382-8aec-e95f5b186b4a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:50.402673 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:50.440756 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-9102eed3-f60c-4382-8aec-e95f5b186b4a admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=d4a72c2333b44771834bf9b11d65d2ff&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2940137
Jun 01 06:18:50.442413 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9102eed3-f60c-4382-8aec-e95f5b186b4a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=61816ead-0838-4423-82ca-df3935d03e68,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:50.443437 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 40126) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:50.445685 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-9102eed3-f60c-4382-8aec-e95f5b186b4a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:50.501998 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7b22b404-a79f-433d-aaa5-6090ef96d803 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:50.530008 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7b22b404-a79f-433d-aaa5-6090ef96d803 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:50.583169 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7b22b404-a79f-433d-aaa5-6090ef96d803 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:50.586909 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-c246ceea-7086-4e11-b363-b3e8f555f8c5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:50.601107 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b22b404-a79f-433d-aaa5-6090ef96d803 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=61816ead-0838-4423-82ca-df3935d03e68,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:50.610700 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b22b404-a79f-433d-aaa5-6090ef96d803 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:50.611079 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b22b404-a79f-433d-aaa5-6090ef96d803 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:50.611450 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b22b404-a79f-433d-aaa5-6090ef96d803 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:50.611838 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b22b404-a79f-433d-aaa5-6090ef96d803 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:50.612205 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b22b404-a79f-433d-aaa5-6090ef96d803 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:50.612567 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b22b404-a79f-433d-aaa5-6090ef96d803 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:50.612923 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b22b404-a79f-433d-aaa5-6090ef96d803 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:50.613279 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b22b404-a79f-433d-aaa5-6090ef96d803 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:50.613661 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b22b404-a79f-433d-aaa5-6090ef96d803 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:50.614020 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b22b404-a79f-433d-aaa5-6090ef96d803 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:50.614369 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b22b404-a79f-433d-aaa5-6090ef96d803 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:50.614716 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b22b404-a79f-433d-aaa5-6090ef96d803 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:18:50.617261 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-7b22b404-a79f-433d-aaa5-6090ef96d803 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:50.618359 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-7b22b404-a79f-433d-aaa5-6090ef96d803 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/61816ead-0838-4423-82ca-df3935d03e68 HTTP/1.1" status: 204  len: 168 time: 0.1739213
Jun 01 06:18:50.620008 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-7b22b404-a79f-433d-aaa5-6090ef96d803 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:53.724086 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:18:55.268501 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4a00133c-5e0f-484a-8bd1-9afc963587d3 req-10eec6b0-eea2-4d04-9188-98000c76c31e tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1799299822&fields=id&tenant_id=c0ca2b878b874fe4af6e7b9fa8f6cf59 HTTP/1.1" status: 200  len: 267 time: 0.0422945
Jun 01 06:18:55.360108 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a00133c-5e0f-484a-8bd1-9afc963587d3 req-1842bc7b-6108-46cd-b5b7-eba900112ffe tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:55.361460 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4a00133c-5e0f-484a-8bd1-9afc963587d3 req-1842bc7b-6108-46cd-b5b7-eba900112ffe tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 984 time: 0.0876634
Jun 01 06:18:55.372547 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-4a00133c-5e0f-484a-8bd1-9afc963587d3 req-0b8d1c69-374c-49ea-a401-f15fabe5357a tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Request body: {'port': {'security_groups': ['5985373d-9e4a-40aa-ae6a-494024c07169']}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:18:55.496756 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-4a00133c-5e0f-484a-8bd1-9afc963587d3 req-0b8d1c69-374c-49ea-a401-f15fabe5357a tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:55.758631 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-4a00133c-5e0f-484a-8bd1-9afc963587d3 req-0b8d1c69-374c-49ea-a401-f15fabe5357a tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] For port 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=8a7ac687-d801-4596-95ac-7b5a0bb4a7a7,segment=NetworkSegment(c40d74a4-eecc-4c63-8fd5-38ee39e77ccd),segment_id=c40d74a4-eecc-4c63-8fd5-38ee39e77ccd)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:18:55.790426 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-4a00133c-5e0f-484a-8bd1-9afc963587d3 req-0b8d1c69-374c-49ea-a401-f15fabe5357a tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:55.795380 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-4a00133c-5e0f-484a-8bd1-9afc963587d3 req-0b8d1c69-374c-49ea-a401-f15fabe5357a tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2077419'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:55.801447 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-7c212c4a-89a3-4e39-aa8a-1a0cd1515087 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:55.870075 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a00133c-5e0f-484a-8bd1-9afc963587d3 req-0b8d1c69-374c-49ea-a401-f15fabe5357a tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:55.870712 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-4a00133c-5e0f-484a-8bd1-9afc963587d3 req-0b8d1c69-374c-49ea-a401-f15fabe5357a tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:55.872110 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4a00133c-5e0f-484a-8bd1-9afc963587d3 req-0b8d1c69-374c-49ea-a401-f15fabe5357a tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "PUT /v2.0/ports/8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 HTTP/1.1" status: 200  len: 942 time: 0.5044188
Jun 01 06:18:55.872629 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5f919b7d-49a2-4b7d-bab0-b076bda23370', 'tag': '8a7ac687-d801-4596-95ac-7b5a0bb4a7a7'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:18:55.874915 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-46294b7b-432c-4cd0-a44f-66443eb5f0d4" -d '{"events": [{"name": "network-changed", "server_uuid": "5f919b7d-49a2-4b7d-bab0-b076bda23370", "tag": "8a7ac687-d801-4596-95ac-7b5a0bb4a7a7"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:18:55.878261 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 40194) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:55.894826 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b8d1c69-374c-49ea-a401-f15fabe5357a tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Pushing event updated for resources: {'Port': ['ID=8a7ac687-d801-4596-95ac-7b5a0bb4a7a7,revision_number=7']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:55.898070 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-0b8d1c69-374c-49ea-a401-f15fabe5357a tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:55.929912 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:18:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-94278e09-796a-4406-8c04-373d51c7ee07 x-openstack-request-id: req-94278e09-796a-4406-8c04-373d51c7ee07 {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:18:55.930239 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5f919b7d-49a2-4b7d-bab0-b076bda23370", "tag": "8a7ac687-d801-4596-95ac-7b5a0bb4a7a7", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:18:55.930531 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-94278e09-796a-4406-8c04-373d51c7ee07 {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:18:55.930966 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5f919b7d-49a2-4b7d-bab0-b076bda23370', 'tag': '8a7ac687-d801-4596-95ac-7b5a0bb4a7a7', 'status': 'completed', 'code': 200}
Jun 01 06:18:55.969469 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8b9d5356-7a03-493d-b901-cc26455b0fcd tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:56.001136 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8b9d5356-7a03-493d-b901-cc26455b0fcd tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:56.078910 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8b9d5356-7a03-493d-b901-cc26455b0fcd tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:56.083115 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-99337506-a8c7-483e-b674-c68923b32fcb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:56.101031 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b9d5356-7a03-493d-b901-cc26455b0fcd tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8b6148b9-b790-4563-ad28-9c548198b033,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:56.103307 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-8b9d5356-7a03-493d-b901-cc26455b0fcd tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:56.115082 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-8b9d5356-7a03-493d-b901-cc26455b0fcd tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:56.116270 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-8b9d5356-7a03-493d-b901-cc26455b0fcd tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "DELETE /v2.0/security-groups/8b6148b9-b790-4563-ad28-9c548198b033 HTTP/1.1" status: 204  len: 168 time: 0.2352002
Jun 01 06:18:56.119622 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 40198) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:18:56.159074 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-23a8755e-7154-429e-afa5-1a5d94935a03 None None] Provisioning complete for port 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:18:56.159656 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-23a8755e-7154-429e-afa5-1a5d94935a03 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:56.398372 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-d1d15835-5452-4606-8798-4ce279be305f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Deleting port f9f8734a-9237-43bc-92cd-2cbe6695bb5b {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:18:56.398709 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d1d15835-5452-4606-8798-4ce279be305f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:56.520826 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d1d15835-5452-4606-8798-4ce279be305f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:56.521139 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d1d15835-5452-4606-8798-4ce279be305f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:56.647200 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-d1d15835-5452-4606-8798-4ce279be305f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Calling delete_port for f9f8734a-9237-43bc-92cd-2cbe6695bb5b owned by network:floatingip {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:18:56.783864 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d1d15835-5452-4606-8798-4ce279be305f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:56.788809 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-201b3583-2a4e-403b-81de-92999df97446 tempest-AttachVolumeNegativeTest-921116677 tempest-AttachVolumeNegativeTest-921116677-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:18:56.834780 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1d15835-5452-4606-8798-4ce279be305f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Pushing event deleted for resources: {'Port': ['ID=f9f8734a-9237-43bc-92cd-2cbe6695bb5b,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:18:56.865067 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-d1d15835-5452-4606-8798-4ce279be305f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:18:56.926661 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d1d15835-5452-4606-8798-4ce279be305f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks [] for floatingip, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:56.927367 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.db.l3_db [None req-d1d15835-5452-4606-8798-4ce279be305f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Floating IP 1945cc30-f010-48ee-8395-8f1719cf31be disassociated (deleted). External IP: 172.27.2.155, port: 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7.
Jun 01 06:18:57.392646 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d1d15835-5452-4606-8798-4ce279be305f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Router 4b9daac3-8875-4acd-af69-09a389effcf9 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92230) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:18:57.593024 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d1d15835-5452-4606-8798-4ce279be305f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:18:57.604845 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e616ccf-e461-47c2-a111-a9460aa2468c None None] Sync routers for ids ['4b9daac3-8875-4acd-af69-09a389effcf9'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:18:57.614617 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e616ccf-e461-47c2-a111-a9460aa2468c None None] Routers {'4b9daac3-8875-4acd-af69-09a389effcf9'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:18:57.614824 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d1d15835-5452-4606-8798-4ce279be305f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for floatingip, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:18:57.615249 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-4e616ccf-e461-47c2-a111-a9460aa2468c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b23fa1c0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:18:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['4b9daac3-8875-4acd-af69-09a389effcf9'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:57.672044 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-d1d15835-5452-4606-8798-4ce279be305f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "DELETE /v2.0/floatingips/1945cc30-f010-48ee-8395-8f1719cf31be HTTP/1.1" status: 204  len: 168 time: 1.5513811
Jun 01 06:18:57.672713 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5f919b7d-49a2-4b7d-bab0-b076bda23370', 'tag': '8a7ac687-d801-4596-95ac-7b5a0bb4a7a7'}] {{(pid=92230) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:18:57.675205 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a8971187fdc179bafebfda031591b22633150c3ea1d9449252a7819502f19756" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-167680f6-e5c8-4ed4-b366-10099c0eeef3" -d '{"events": [{"name": "network-changed", "server_uuid": "5f919b7d-49a2-4b7d-bab0-b076bda23370", "tag": "8a7ac687-d801-4596-95ac-7b5a0bb4a7a7"}]}' {{(pid=92230) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:18:57.726603 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:18:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-abb7cdd6-29df-4fa3-87f0-6ce9265c6431 x-openstack-request-id: req-abb7cdd6-29df-4fa3-87f0-6ce9265c6431 {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:18:57.727074 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5f919b7d-49a2-4b7d-bab0-b076bda23370", "tag": "8a7ac687-d801-4596-95ac-7b5a0bb4a7a7", "status": "completed", "code": 200}]} {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:18:57.727376 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-abb7cdd6-29df-4fa3-87f0-6ce9265c6431 {{(pid=92230) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:18:57.727881 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5f919b7d-49a2-4b7d-bab0-b076bda23370', 'tag': '8a7ac687-d801-4596-95ac-7b5a0bb4a7a7', 'status': 'completed', 'code': 200}
Jun 01 06:18:57.809053 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-4e616ccf-e461-47c2-a111-a9460aa2468c None None] Set router 4b9daac3-8875-4acd-af69-09a389effcf9 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:18:58.146210 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-4e616ccf-e461-47c2-a111-a9460aa2468c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b23fa1c0>, [{'id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'name': 'tempest-TestMinimumBasicScenario-2100526911-router', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54'}], 'enable_snat': True}, 'gw_port_id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:15:55Z', 'updated_at': '2021-06-01T06:16:02Z', 'revision_number': 4, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'gw_port': {'id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:16:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:15:56Z', 'updated_at': '2021-06-01T06:16:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': 'ac9595c2-fb73-47ad-a4a7-a8318ad01d8c', 'name': '', 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'mac_address': 'fa:16:3e:a7:87:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'device_owner': 'network:router_interface', 'standard_attr_id': 537, 'fixed_ips': [{'subnet_id': '27e7a9e0-ab4e-478c-aff2-55a26159dc84', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:16:01Z', 'updated_at': '2021-06-01T06:16:08Z', 'revision_number': 5, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'subnets': [{'id': '27e7a9e0-ab4e-478c-aff2-55a26159dc84', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:58.149978 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e616ccf-e461-47c2-a111-a9460aa2468c None None] Checking router: 4b9daac3-8875-4acd-af69-09a389effcf9 for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:18:58.158990 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e616ccf-e461-47c2-a111-a9460aa2468c None None] Routers {'4b9daac3-8875-4acd-af69-09a389effcf9'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:18:58.159511 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-4e616ccf-e461-47c2-a111-a9460aa2468c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b23fa1c0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:18:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['4b9daac3-8875-4acd-af69-09a389effcf9'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:58.337457 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-4e616ccf-e461-47c2-a111-a9460aa2468c None None] Set router 4b9daac3-8875-4acd-af69-09a389effcf9 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:18:58.577780 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['8a7ac687-d801-4596-95ac-7b5a0bb4a7a7'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:18:58.682763 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46294b7b-432c-4cd0-a44f-66443eb5f0d4 req-66868097-3c19-4ee8-937d-13199fbf50c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:58.684298 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-46294b7b-432c-4cd0-a44f-66443eb5f0d4 req-66868097-3c19-4ee8-937d-13199fbf50c9 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=c0ca2b878b874fe4af6e7b9fa8f6cf59&device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 1098 time: 0.0918705
Jun 01 06:18:58.686728 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['8a7ac687-d801-4596-95ac-7b5a0bb4a7a7'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:18:58.822026 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46294b7b-432c-4cd0-a44f-66443eb5f0d4 req-c69c9e33-d341-4679-a64b-e2cfa023cdff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:58.823980 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-46294b7b-432c-4cd0-a44f-66443eb5f0d4 req-c69c9e33-d341-4679-a64b-e2cfa023cdff service neutron] 10.222.0.48 "GET /v2.0/networks?id=d36c4486-6b2d-4439-996b-f13c04a98cb8 HTTP/1.1" status: 200  len: 916 time: 0.1323164
Jun 01 06:18:58.890755 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-4e616ccf-e461-47c2-a111-a9460aa2468c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b23fa1c0>, [{'id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'name': 'tempest-TestMinimumBasicScenario-2100526911-router', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54'}], 'enable_snat': True}, 'gw_port_id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:15:55Z', 'updated_at': '2021-06-01T06:16:02Z', 'revision_number': 4, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'gw_port': {'id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:16:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:15:56Z', 'updated_at': '2021-06-01T06:16:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': 'ac9595c2-fb73-47ad-a4a7-a8318ad01d8c', 'name': '', 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'mac_address': 'fa:16:3e:a7:87:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'device_owner': 'network:router_interface', 'standard_attr_id': 537, 'fixed_ips': [{'subnet_id': '27e7a9e0-ab4e-478c-aff2-55a26159dc84', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:16:01Z', 'updated_at': '2021-06-01T06:16:08Z', 'revision_number': 5, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'subnets': [{'id': '27e7a9e0-ab4e-478c-aff2-55a26159dc84', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:18:58.897214 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-46294b7b-432c-4cd0-a44f-66443eb5f0d4 req-960ffae3-f134-4de7-ac81-4306fedcd260 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 HTTP/1.1" status: 200  len: 217 time: 0.0662274
Jun 01 06:18:58.909863 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e616ccf-e461-47c2-a111-a9460aa2468c None None] The sync data for ids ['4b9daac3-8875-4acd-af69-09a389effcf9'] in dv-cinder-793885-1-iscsi is: [{'id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'name': 'tempest-TestMinimumBasicScenario-2100526911-router', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54'}], 'enable_snat': True}, 'gw_port_id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:15:55Z', 'updated_at': '2021-06-01T06:16:02Z', 'revision_number': 4, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'gw_port': {'id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:16:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:15:56Z', 'updated_at': '2021-06-01T06:16:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': 'ac9595c2-fb73-47ad-a4a7-a8318ad01d8c', 'name': '', 'network_id': 'd36c4486-6b2d-4439-996b-f13c04a98cb8', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'mac_address': 'fa:16:3e:a7:87:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'device_owner': 'network:router_interface', 'standard_attr_id': 537, 'fixed_ips': [{'subnet_id': '27e7a9e0-ab4e-478c-aff2-55a26159dc84', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:16:01Z', 'updated_at': '2021-06-01T06:16:08Z', 'revision_number': 5, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'subnets': [{'id': '27e7a9e0-ab4e-478c-aff2-55a26159dc84', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:18:58.964674 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46294b7b-432c-4cd0-a44f-66443eb5f0d4 req-12dd1397-9290-4285-8b06-7e60fbd20b71 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:58.966421 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-46294b7b-432c-4cd0-a44f-66443eb5f0d4 req-12dd1397-9290-4285-8b06-7e60fbd20b71 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=27e7a9e0-ab4e-478c-aff2-55a26159dc84 HTTP/1.1" status: 200  len: 854 time: 0.0616167
Jun 01 06:18:59.053015 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46294b7b-432c-4cd0-a44f-66443eb5f0d4 req-954d8ffa-2905-4e26-81c2-1cac9eb3bb3a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:59.054647 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-46294b7b-432c-4cd0-a44f-66443eb5f0d4 req-954d8ffa-2905-4e26-81c2-1cac9eb3bb3a service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=d36c4486-6b2d-4439-996b-f13c04a98cb8&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0800383
Jun 01 06:18:59.164302 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-762bff13-6a79-47c9-b0fd-4eac8fa414e2 None None] New status for floating IP 1945cc30-f010-48ee-8395-8f1719cf31be: DOWN {{(pid=92232) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 06:18:59.205753 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-46294b7b-432c-4cd0-a44f-66443eb5f0d4 req-b71ca07c-174f-472b-8b75-e2ef03a211dd service neutron] 10.222.0.48 "GET /v2.0/networks/d36c4486-6b2d-4439-996b-f13c04a98cb8?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1433871
Jun 01 06:18:59.358139 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-46294b7b-432c-4cd0-a44f-66443eb5f0d4 req-ed1b959a-3aec-4cde-80e3-d0d616b68097 service neutron] 10.222.0.48 "GET /v2.0/networks/d36c4486-6b2d-4439-996b-f13c04a98cb8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1447937
Jun 01 06:18:59.583946 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-167680f6-e5c8-4ed4-b366-10099c0eeef3 req-27ebcbc1-ea1f-4811-9029-d728f2d687e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:59.585339 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-167680f6-e5c8-4ed4-b366-10099c0eeef3 req-27ebcbc1-ea1f-4811-9029-d728f2d687e7 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=c0ca2b878b874fe4af6e7b9fa8f6cf59&device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 1098 time: 0.1817679
Jun 01 06:18:59.733518 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-167680f6-e5c8-4ed4-b366-10099c0eeef3 req-f9e6c27e-d0c0-42da-b6ad-928a4d6df90c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:59.735085 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-167680f6-e5c8-4ed4-b366-10099c0eeef3 req-f9e6c27e-d0c0-42da-b6ad-928a4d6df90c service neutron] 10.222.0.48 "GET /v2.0/networks?id=d36c4486-6b2d-4439-996b-f13c04a98cb8 HTTP/1.1" status: 200  len: 916 time: 0.1424677
Jun 01 06:18:59.820422 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-167680f6-e5c8-4ed4-b366-10099c0eeef3 req-e3202db5-9176-45a6-b35b-278b2fb6e60d service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 HTTP/1.1" status: 200  len: 217 time: 0.0697010
Jun 01 06:18:59.888690 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-167680f6-e5c8-4ed4-b366-10099c0eeef3 req-9adbd327-e1f0-4259-9fa2-c79d1f876b30 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:59.890762 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-167680f6-e5c8-4ed4-b366-10099c0eeef3 req-9adbd327-e1f0-4259-9fa2-c79d1f876b30 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=27e7a9e0-ab4e-478c-aff2-55a26159dc84 HTTP/1.1" status: 200  len: 854 time: 0.0642159
Jun 01 06:18:59.971653 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-167680f6-e5c8-4ed4-b366-10099c0eeef3 req-69264284-7500-4ee1-884d-14cc03b59328 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:18:59.973230 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-167680f6-e5c8-4ed4-b366-10099c0eeef3 req-69264284-7500-4ee1-884d-14cc03b59328 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=d36c4486-6b2d-4439-996b-f13c04a98cb8&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0769041
Jun 01 06:19:00.117672 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-167680f6-e5c8-4ed4-b366-10099c0eeef3 req-b2709dd9-be0f-460b-9b15-f553075d4e86 service neutron] 10.222.0.48 "GET /v2.0/networks/d36c4486-6b2d-4439-996b-f13c04a98cb8?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1362550
Jun 01 06:19:00.263303 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-167680f6-e5c8-4ed4-b366-10099c0eeef3 req-0b813afa-3570-4355-b0ac-a2e4b3582df0 service neutron] 10.222.0.48 "GET /v2.0/networks/d36c4486-6b2d-4439-996b-f13c04a98cb8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1389480
Jun 01 06:19:08.371331 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-1c92439f-ebf7-4a2c-8717-f1116df8db59 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:11.243662 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:12.351194 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4787bf6c-6b9b-4c01-af3b-83bc8bb145c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:12.698364 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 40366) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:12.819673 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9e6f6dd2-9460-4099-b2ce-c107b8bd6efd admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:12.834395 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-9e6f6dd2-9460-4099-b2ce-c107b8bd6efd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:19:12.838627 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-9e6f6dd2-9460-4099-b2ce-c107b8bd6efd admin admin] Usage tracker for resource:security_group_rule and tenant:a0b416d9723f4a4883f2e7ac206da650 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:19:12.841522 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-9e6f6dd2-9460-4099-b2ce-c107b8bd6efd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:19:12.847241 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-9e6f6dd2-9460-4099-b2ce-c107b8bd6efd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:19:12.937564 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9e6f6dd2-9460-4099-b2ce-c107b8bd6efd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:12.941634 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-9e6f6dd2-9460-4099-b2ce-c107b8bd6efd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:12.952459 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-fedc0ed2-c283-469f-9d3d-83e371756701 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:12.993229 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-9e6f6dd2-9460-4099-b2ce-c107b8bd6efd admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=a0b416d9723f4a4883f2e7ac206da650&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2935562
Jun 01 06:19:12.994576 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e6f6dd2-9460-4099-b2ce-c107b8bd6efd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cc8a704c-0dd5-4719-a243-7c5b880afa31,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:12.996364 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 40372) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:12.997753 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-9e6f6dd2-9460-4099-b2ce-c107b8bd6efd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:13.060751 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3e196e12-9c7d-4597-b628-2b132274156f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:13.088096 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3e196e12-9c7d-4597-b628-2b132274156f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:13.149558 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3e196e12-9c7d-4597-b628-2b132274156f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:13.154163 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-8feb9422-fdb1-40aa-88c6-583e810e94fc tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:13.169200 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e196e12-9c7d-4597-b628-2b132274156f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc8a704c-0dd5-4719-a243-7c5b880afa31,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:13.173102 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-3e196e12-9c7d-4597-b628-2b132274156f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:13.180509 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3e196e12-9c7d-4597-b628-2b132274156f admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:13.184018 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-3e196e12-9c7d-4597-b628-2b132274156f admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/cc8a704c-0dd5-4719-a243-7c5b880afa31 HTTP/1.1" status: 204  len: 168 time: 0.1862755
Jun 01 06:19:13.285966 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:15.303706 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-887d5d51-cba2-457e-9869-b340d6212a03 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1032536289&fields=id&tenant_id=e8bcff3fed924886a68a8562a9f4f8f3 HTTP/1.1" status: 200  len: 267 time: 0.0850806
Jun 01 06:19:15.383020 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:15.481526 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-927ba729-2811-4bb8-a5ec-cec8a86c0bda req-debaa7e5-eab9-4fb4-ab1b-599ef5670f10 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:15.482914 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-927ba729-2811-4bb8-a5ec-cec8a86c0bda req-debaa7e5-eab9-4fb4-ab1b-599ef5670f10 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 945 time: 0.2270825
Jun 01 06:19:15.493379 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-751bc204-c778-4664-9f6a-548f2915f4d5 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:15.495318 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-751bc204-c778-4664-9f6a-548f2915f4d5 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/networks?id=028fef0a-f05a-48d5-ba5c-b539846209ba HTTP/1.1" status: 200  len: 811 time: 0.1840005
Jun 01 06:19:15.525285 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-ddbbfda5-5b51-4519-8af0-e8ca6e7b55ec tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/quotas/e8bcff3fed924886a68a8562a9f4f8f3 HTTP/1.1" status: 200  len: 375 time: 0.0161099
Jun 01 06:19:15.592024 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-927ba729-2811-4bb8-a5ec-cec8a86c0bda req-c3a472bb-30c0-451f-89b0-94f42acb2f9e tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0957003
Jun 01 06:19:15.635155 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-41144e11-6ac2-44d6-b647-29e1f799175e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=e8bcff3fed924886a68a8562a9f4f8f3&fields=id HTTP/1.1" status: 200  len: 440 time: 0.1018054
Jun 01 06:19:15.904078 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-abd29fa9-f99e-4b82-9b07-049b953b981e service neutron] 10.222.0.25 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2559361
Jun 01 06:19:16.024649 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:16.049780 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-88595ff9-5c7f-4852-a160-1a87e1f420f4 service neutron] 10.222.0.25 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1392140
Jun 01 06:19:16.463959 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-735dacc2-7fd7-4afc-b17f-f157a7001425 req-4148f48d-65d8-4d3c-9e09-7c9bc2da70be tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 210 time: 0.0529943
Jun 01 06:19:16.805844 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0bf8bf9-98c6-4304-97c8-e3626f4baec0 req-cbe7a2a1-cc14-45d5-ab34-c37c28a0fc0f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:16.808046 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c0bf8bf9-98c6-4304-97c8-e3626f4baec0 req-cbe7a2a1-cc14-45d5-ab34-c37c28a0fc0f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 945 time: 0.0874908
Jun 01 06:19:16.855066 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c0bf8bf9-98c6-4304-97c8-e3626f4baec0 req-89f9ab0b-aaa7-4f5b-862f-ef241c06f3cf tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0410445
Jun 01 06:19:17.731889 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fb9d8fc8-f088-4583-bf7c-93dd16ce4f3e req-c3f7fe35-16b8-4bc2-94cb-48a8800a81ec tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 210 time: 0.1570392
Jun 01 06:19:18.043984 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cebb3154-488d-45fe-b539-d8bcacba5e53 req-36fb6a4a-0f02-4030-961e-1fd8f05601cc tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:18.045496 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cebb3154-488d-45fe-b539-d8bcacba5e53 req-36fb6a4a-0f02-4030-961e-1fd8f05601cc tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 945 time: 0.0821018
Jun 01 06:19:18.096196 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cebb3154-488d-45fe-b539-d8bcacba5e53 req-274463f0-efae-4b79-9a6c-df7f67d4f9f2 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0447919
Jun 01 06:19:18.882994 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-df49c03a-1ab9-45d0-8abd-93eec469d38d req-a8f5a128-28e0-4912-af27-183f4588525c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 210 time: 0.0419385
Jun 01 06:19:19.292906 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42b085a8-3265-4ab0-8148-fd66ccfd0400 req-3aaf9a88-2ff5-45a1-b8d4-a2c5bf5b5fdf tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:19.294467 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-42b085a8-3265-4ab0-8148-fd66ccfd0400 req-3aaf9a88-2ff5-45a1-b8d4-a2c5bf5b5fdf tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 945 time: 0.0835786
Jun 01 06:19:19.351058 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-42b085a8-3265-4ab0-8148-fd66ccfd0400 req-98d0cfbd-f04d-43ff-936e-c76325becb14 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0487134
Jun 01 06:19:20.037339 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4a930c46-40fa-49a7-a343-67ea004fa250 req-79802301-1aa3-4a6b-9aa6-6b55435955c9 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 210 time: 0.0439680
Jun 01 06:19:20.542349 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03fa9536-c1cb-4ce3-86bf-8f5f30b6cd7d req-dda0311f-b2a2-42f2-a897-cafedfada6e5 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:20.543886 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-03fa9536-c1cb-4ce3-86bf-8f5f30b6cd7d req-dda0311f-b2a2-42f2-a897-cafedfada6e5 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 945 time: 0.0810609
Jun 01 06:19:20.590139 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-03fa9536-c1cb-4ce3-86bf-8f5f30b6cd7d req-2982a104-1eed-475f-9c31-2485ab4a67fc tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0405011
Jun 01 06:19:21.192587 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-be4a3926-9a17-4814-b09b-d03776c2c767 req-30d9e4e6-4351-413c-9c41-dc260f771123 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 210 time: 0.0481331
Jun 01 06:19:21.511990 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-a316ca92-28ec-4a73-96d5-1044ef7bbf1f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:21.513438 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-a316ca92-28ec-4a73-96d5-1044ef7bbf1f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.48 "GET /v2.0/networks?id=028fef0a-f05a-48d5-ba5c-b539846209ba HTTP/1.1" status: 200  len: 811 time: 0.1541760
Jun 01 06:19:21.568558 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-42638edb-3209-4dfe-869f-2bd6bd2c6e74 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.48 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=e8bcff3fed924886a68a8562a9f4f8f3 HTTP/1.1" status: 200  len: 380 time: 0.0452003
Jun 01 06:19:21.578426 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-9830a07d-f5d7-4646-8258-aacf963d271e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Request body: {'port': {'device_id': 'af5f753c-f6ea-450a-ac47-3802c6b16eb3', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'admin_state_up': True, 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'security_groups': ['837b69a3-6811-4cdc-8ade-9ad4352f4196']}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:19:21.785380 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-9830a07d-f5d7-4646-8258-aacf963d271e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:19:21.801424 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-9830a07d-f5d7-4646-8258-aacf963d271e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:19:21.815020 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-9830a07d-f5d7-4646-8258-aacf963d271e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Made reservation on behalf of e8bcff3fed924886a68a8562a9f4f8f3 for: {'port': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:19:21.818436 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-9830a07d-f5d7-4646-8258-aacf963d271e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:21.854483 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9adcfe1-94c2-4c03-894d-48da6c1e55a1 req-3f733b5e-8d17-4bc5-813c-6428ff60f121 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:21.855982 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c9adcfe1-94c2-4c03-894d-48da6c1e55a1 req-3f733b5e-8d17-4bc5-813c-6428ff60f121 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 945 time: 0.1507051
Jun 01 06:19:21.965087 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c9adcfe1-94c2-4c03-894d-48da6c1e55a1 req-ed51112c-29c6-4601-b5c7-21c907a02c4f tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0723855
Jun 01 06:19:22.045507 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-9830a07d-f5d7-4646-8258-aacf963d271e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Allocated IP 172.20.0.3 (028fef0a-f05a-48d5-ba5c-b539846209ba/cdffe000-7f35-495d-a741-b4c48a060887/5fa581a1-474d-4dc6-a414-36e7324b8555) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:19:22.277718 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-9830a07d-f5d7-4646-8258-aacf963d271e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:22.299903 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-9830a07d-f5d7-4646-8258-aacf963d271e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Transition to ACTIVE for port object 5fa581a1-474d-4dc6-a414-36e7324b8555 will not be triggered until provisioned by entity DHCP. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:19:22.341851 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-9830a07d-f5d7-4646-8258-aacf963d271e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:22.350591 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-7a9e5c46-f3df-411d-acac-30e8f031ada8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:22.486470 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-9830a07d-f5d7-4646-8258-aacf963d271e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Network 028fef0a-f05a-48d5-ba5c-b539846209ba is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:19:22.491671 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-9830a07d-f5d7-4646-8258-aacf963d271e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:19:22.495702 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9830a07d-f5d7-4646-8258-aacf963d271e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Pushing event updated for resources: {'Port': ['ID=5fa581a1-474d-4dc6-a414-36e7324b8555,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:22.498028 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-9830a07d-f5d7-4646-8258-aacf963d271e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:19:22.560476 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-9830a07d-f5d7-4646-8258-aacf963d271e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.208s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:22.594672 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-9830a07d-f5d7-4646-8258-aacf963d271e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:22.595356 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-9830a07d-f5d7-4646-8258-aacf963d271e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:22.709034 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-9830a07d-f5d7-4646-8258-aacf963d271e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.1347380
Jun 01 06:19:22.719059 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7839ca3-0b6c-48bd-8cff-110180783bde req-6fed8def-7d6b-4d8f-82c5-f3401d96226e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:22.719861 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-b7839ca3-0b6c-48bd-8cff-110180783bde req-6fed8def-7d6b-4d8f-82c5-f3401d96226e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Synchronizing usage tracker for tenant:e8bcff3fed924886a68a8562a9f4f8f3 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:19:22.731845 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] Request body: {'port': {'device_id': 'af5f753c-f6ea-450a-ac47-3802c6b16eb3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79388'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:19:22.779685 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-3c099ef9-78b8-4ea5-b343-d372cec7249c None None] Provisioning for port 5fa581a1-474d-4dc6-a414-36e7324b8555 completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:19:22.784548 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-3c099ef9-78b8-4ea5-b343-d372cec7249c None None] Provisioning complete for port 5fa581a1-474d-4dc6-a414-36e7324b8555 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:19:22.784920 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-3c099ef9-78b8-4ea5-b343-d372cec7249c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:22.803492 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-b7839ca3-0b6c-48bd-8cff-110180783bde req-6fed8def-7d6b-4d8f-82c5-f3401d96226e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Unset dirty status for tenant:e8bcff3fed924886a68a8562a9f4f8f3 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:19:22.804717 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b7839ca3-0b6c-48bd-8cff-110180783bde req-6fed8def-7d6b-4d8f-82c5-f3401d96226e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 931 time: 0.4187016
Jun 01 06:19:22.853603 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-3c099ef9-78b8-4ea5-b343-d372cec7249c None None] Port 5fa581a1-474d-4dc6-a414-36e7324b8555 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:19:22.965031 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07c016f2-3a80-404d-a974-c716e2519bd2 req-51ff3efe-e8f0-4382-992a-c4c108bf25c4 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:22.966461 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-07c016f2-3a80-404d-a974-c716e2519bd2 req-51ff3efe-e8f0-4382-992a-c4c108bf25c4 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.48 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 945 time: 0.3384244
Jun 01 06:19:23.018065 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:23.037602 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b7839ca3-0b6c-48bd-8cff-110180783bde req-e57f31ec-8bf7-4baf-a044-eeb9bb575210 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1992028
Jun 01 06:19:23.262332 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f39acad2-78ad-4874-9fac-abdeb780e76c req-a71945f8-d080-4c6e-ad68-c3dfd498bb11 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:23.263812 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f39acad2-78ad-4874-9fac-abdeb780e76c req-a71945f8-d080-4c6e-ad68-c3dfd498bb11 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 945 time: 0.1855388
Jun 01 06:19:23.406509 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f39acad2-78ad-4874-9fac-abdeb780e76c req-c8560119-518d-40fe-aa18-b558842a9034 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1364408
Jun 01 06:19:23.528795 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5fa581a1-474d-4dc6-a414-36e7324b8555 {{(pid=92229) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:19:23.536299 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:23.552771 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] Transition to ACTIVE for port object 5fa581a1-474d-4dc6-a414-36e7324b8555 will not be triggered until provisioned by entity L2. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:19:23.557141 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2077419'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:23.561375 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-f3df55b6-13cf-4b75-b6de-20a32cfa8be3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:23.727311 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] Pushing event updated for resources: {'Port': ['ID=5fa581a1-474d-4dc6-a414-36e7324b8555,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:23.731714 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:23.819161 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] Attempting to bind port 5fa581a1-474d-4dc6-a414-36e7324b8555 on host hv-cinder-79388 for vnic_type normal with profile  {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:19:23.819486 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] Attempting to bind port 5fa581a1-474d-4dc6-a414-36e7324b8555 by drivers openvswitch,hyperv on host hv-cinder-79388 at level 0 using segments [{'id': 'e9a368be-e119-4f56-bdcc-b9d10543e0d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 209, 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba'}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:19:23.819829 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] Attempting to bind port 5fa581a1-474d-4dc6-a414-36e7324b8555 on network 028fef0a-f05a-48d5-ba5c-b539846209ba {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:19:23.825247 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] Port 5fa581a1-474d-4dc6-a414-36e7324b8555 on network 028fef0a-f05a-48d5-ba5c-b539846209ba not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79388 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 06:19:23.825554 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] Attempting to bind port 5fa581a1-474d-4dc6-a414-36e7324b8555 on network 028fef0a-f05a-48d5-ba5c-b539846209ba {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:19:23.830751 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] Checking agent: {'id': '56148394-2131-4d06-bcfa-c032301591b8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79388', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'started_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 19, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:19:23.831546 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] Checking segment: {'id': 'e9a368be-e119-4f56-bdcc-b9d10543e0d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 209, 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:19:23.831546 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] Bound using segment: {'id': 'e9a368be-e119-4f56-bdcc-b9d10543e0d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 209, 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba'} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:19:23.832274 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] Bound port: 5fa581a1-474d-4dc6-a414-36e7324b8555, host: hv-cinder-79388, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e9a368be-e119-4f56-bdcc-b9d10543e0d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 209, 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba'}}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:19:23.832274 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:24.020207 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] For port 5fa581a1-474d-4dc6-a414-36e7324b8555, host hv-cinder-79388, cleared binding levels {{(pid=92229) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:19:24.035479 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] For port 5fa581a1-474d-4dc6-a414-36e7324b8555, host hv-cinder-79388, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=5fa581a1-474d-4dc6-a414-36e7324b8555,segment=NetworkSegment(e9a368be-e119-4f56-bdcc-b9d10543e0d8),segment_id=e9a368be-e119-4f56-bdcc-b9d10543e0d8)] {{(pid=92229) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:19:24.039620 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2077419'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:24.045684 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-8b35ed65-e73d-4d91-b6fd-52150e87e203 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:24.104459 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:24.105074 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:24.106474 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] 10.222.0.48 "PUT /v2.0/ports/5fa581a1-474d-4dc6-a414-36e7324b8555 HTTP/1.1" status: 200  len: 1093 time: 1.3799937
Jun 01 06:19:24.109633 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'af5f753c-f6ea-450a-ac47-3802c6b16eb3', 'tag': '5fa581a1-474d-4dc6-a414-36e7324b8555'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:19:24.112218 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-acaa2a1d-e561-4162-a50c-d500a1ce4cbe" -d '{"events": [{"name": "network-changed", "server_uuid": "af5f753c-f6ea-450a-ac47-3802c6b16eb3", "tag": "5fa581a1-474d-4dc6-a414-36e7324b8555"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:19:24.140544 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-07c016f2-3a80-404d-a974-c716e2519bd2 req-2f3a861d-a294-4473-9031-74e4ff0cd350 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Deleting port 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:19:24.140544 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-07c016f2-3a80-404d-a974-c716e2519bd2 req-2f3a861d-a294-4473-9031-74e4ff0cd350 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:24.161711 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] Pushing event updated for resources: {'Port': ['ID=5fa581a1-474d-4dc6-a414-36e7324b8555,revision_number=3']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:24.203253 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-e382ace6-c687-47c0-a5b3-18db6dd4e5be service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:24.225880 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:19:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ea3bfe17-4ba9-4988-8fc0-7d0f33a49a0f x-openstack-request-id: req-ea3bfe17-4ba9-4988-8fc0-7d0f33a49a0f {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:19:24.226203 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "af5f753c-f6ea-450a-ac47-3802c6b16eb3", "tag": "5fa581a1-474d-4dc6-a414-36e7324b8555", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:19:24.226488 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-ea3bfe17-4ba9-4988-8fc0-7d0f33a49a0f {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:19:24.226936 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'af5f753c-f6ea-450a-ac47-3802c6b16eb3', 'tag': '5fa581a1-474d-4dc6-a414-36e7324b8555', 'status': 'completed', 'code': 200}
Jun 01 06:19:24.359762 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-07c016f2-3a80-404d-a974-c716e2519bd2 req-2f3a861d-a294-4473-9031-74e4ff0cd350 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] For port 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=8a7ac687-d801-4596-95ac-7b5a0bb4a7a7,segment=NetworkSegment(c40d74a4-eecc-4c63-8fd5-38ee39e77ccd),segment_id=c40d74a4-eecc-4c63-8fd5-38ee39e77ccd)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:19:24.360145 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-07c016f2-3a80-404d-a974-c716e2519bd2 req-2f3a861d-a294-4473-9031-74e4ff0cd350 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:24.429287 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49d47626-8e6b-465d-99db-eefbaaac1978 req-d65f8c10-9b28-4e25-93f5-6a212acc4b7a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:24.431479 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-49d47626-8e6b-465d-99db-eefbaaac1978 req-d65f8c10-9b28-4e25-93f5-6a212acc4b7a tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 943 time: 0.2729838
Jun 01 06:19:24.498184 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-07c016f2-3a80-404d-a974-c716e2519bd2 req-2f3a861d-a294-4473-9031-74e4ff0cd350 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Calling delete_port for 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 owned by compute:nova {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:19:24.596692 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-49d47626-8e6b-465d-99db-eefbaaac1978 req-251f0d66-eda6-45e5-958b-bff920df1339 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1064959
Jun 01 06:19:24.697998 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d250aab-90b2-4929-a1aa-e6527f537b8d req-9825bf9b-db62-4266-b487-97d21682a99b tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:24.699509 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d250aab-90b2-4929-a1aa-e6527f537b8d req-9825bf9b-db62-4266-b487-97d21682a99b tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 945 time: 0.1650772
Jun 01 06:19:24.766032 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2d250aab-90b2-4929-a1aa-e6527f537b8d req-50a4e609-03d0-4739-8ce0-1e773ec8cc57 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/security-groups?id=5985373d-9e4a-40aa-ae6a-494024c07169&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0595672
Jun 01 06:19:24.766618 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-07c016f2-3a80-404d-a974-c716e2519bd2 req-2f3a861d-a294-4473-9031-74e4ff0cd350 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:24.772413 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-9830a07d-f5d7-4646-8258-aacf963d271e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:24.922095 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f3a861d-a294-4473-9031-74e4ff0cd350 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Pushing event deleted for resources: {'Port': ['ID=8a7ac687-d801-4596-95ac-7b5a0bb4a7a7,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:24.925714 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-2f3a861d-a294-4473-9031-74e4ff0cd350 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:25.004027 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-07c016f2-3a80-404d-a974-c716e2519bd2 req-2f3a861d-a294-4473-9031-74e4ff0cd350 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] No DVR routers for this DVR port 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 on host hv-cinder-79388 {{(pid=92229) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:19:25.006616 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-07c016f2-3a80-404d-a974-c716e2519bd2 req-2f3a861d-a294-4473-9031-74e4ff0cd350 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:25.019039 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-07c016f2-3a80-404d-a974-c716e2519bd2 req-2f3a861d-a294-4473-9031-74e4ff0cd350 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.48 "DELETE /v2.0/ports/8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 HTTP/1.1" status: 204  len: 173 time: 1.1281095
Jun 01 06:19:25.789901 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bee318c-e721-4eb5-b1ea-c6cc001664fe req-ee7e0ac2-a8ce-4de0-aac3-a0038221bca2 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:25.792200 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6bee318c-e721-4eb5-b1ea-c6cc001664fe req-ee7e0ac2-a8ce-4de0-aac3-a0038221bca2 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 943 time: 0.0890503
Jun 01 06:19:25.799128 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['8a7ac687-d801-4596-95ac-7b5a0bb4a7a7'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:19:25.904435 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-6bee318c-e721-4eb5-b1ea-c6cc001664fe req-bfc0f69b-35eb-40d0-875d-904c6c23af6c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1052835
Jun 01 06:19:25.955677 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-cf9bd809-4350-4388-a201-840b4ce95a22 req-5e2b69aa-3ba1-4863-a868-1864a541496e tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Synchronizing usage tracker for tenant:c0ca2b878b874fe4af6e7b9fa8f6cf59 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:19:25.977588 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-cf9bd809-4350-4388-a201-840b4ce95a22 req-5e2b69aa-3ba1-4863-a868-1864a541496e tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Unset dirty status for tenant:c0ca2b878b874fe4af6e7b9fa8f6cf59 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:19:25.978823 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cf9bd809-4350-4388-a201-840b4ce95a22 req-5e2b69aa-3ba1-4863-a868-1864a541496e tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] 10.222.0.25 "GET /v2.0/ports?device_id=5f919b7d-49a2-4b7d-bab0-b076bda23370 HTTP/1.1" status: 200  len: 210 time: 0.0809555
Jun 01 06:19:25.984414 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acaa2a1d-e561-4162-a50c-d500a1ce4cbe req-836f5567-c284-4e10-84bd-d7cec04284b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:25.985893 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-acaa2a1d-e561-4162-a50c-d500a1ce4cbe req-836f5567-c284-4e10-84bd-d7cec04284b0 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=e8bcff3fed924886a68a8562a9f4f8f3&device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 1096 time: 0.1580718
Jun 01 06:19:26.139933 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acaa2a1d-e561-4162-a50c-d500a1ce4cbe req-044d1507-adca-4fda-9d2f-8bec556558aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:26.141429 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-acaa2a1d-e561-4162-a50c-d500a1ce4cbe req-044d1507-adca-4fda-9d2f-8bec556558aa service neutron] 10.222.0.48 "GET /v2.0/networks?tenant_id=e8bcff3fed924886a68a8562a9f4f8f3&shared=False HTTP/1.1" status: 200  len: 912 time: 0.1466992
Jun 01 06:19:26.230375 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5f919b7d-49a2-4b7d-bab0-b076bda23370', 'name': 'network-vif-deleted', 'tag': '8a7ac687-d801-4596-95ac-7b5a0bb4a7a7'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:19:26.232664 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d5ce964c-ea02-4a9e-9ffd-5a9b726a2818" -d '{"events": [{"server_uuid": "5f919b7d-49a2-4b7d-bab0-b076bda23370", "name": "network-vif-deleted", "tag": "8a7ac687-d801-4596-95ac-7b5a0bb4a7a7"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:19:26.286156 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:19:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c8090ef8-2073-46da-8f25-9d9c670af5ba x-openstack-request-id: req-c8090ef8-2073-46da-8f25-9d9c670af5ba {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:19:26.286567 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5f919b7d-49a2-4b7d-bab0-b076bda23370", "name": "network-vif-deleted", "tag": "8a7ac687-d801-4596-95ac-7b5a0bb4a7a7", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:19:26.286793 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-c8090ef8-2073-46da-8f25-9d9c670af5ba {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:19:26.287210 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5f919b7d-49a2-4b7d-bab0-b076bda23370', 'name': 'network-vif-deleted', 'tag': '8a7ac687-d801-4596-95ac-7b5a0bb4a7a7', 'status': 'completed', 'code': 200}
Jun 01 06:19:26.294463 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acaa2a1d-e561-4162-a50c-d500a1ce4cbe req-934ab8df-5d77-47dd-8c59-4488bce90b3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:26.295954 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-acaa2a1d-e561-4162-a50c-d500a1ce4cbe req-934ab8df-5d77-47dd-8c59-4488bce90b3c service neutron] 10.222.0.48 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1452305
Jun 01 06:19:26.426964 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-757f5868-5507-4888-b533-4d93583ab9c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:26.428379 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-757f5868-5507-4888-b533-4d93583ab9c9 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=e8bcff3fed924886a68a8562a9f4f8f3&device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 1096 time: 0.0879490
Jun 01 06:19:26.511179 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-b53e34a9-a150-4213-93bc-f6fd8d1a53ab service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=5fa581a1-474d-4dc6-a414-36e7324b8555 HTTP/1.1" status: 200  len: 217 time: 0.0743029
Jun 01 06:19:26.582991 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-511dadea-3082-4233-9de2-1a8bf668515e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:26.584529 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-511dadea-3082-4233-9de2-1a8bf668515e service neutron] 10.222.0.48 "GET /v2.0/subnets?id=cdffe000-7f35-495d-a741-b4c48a060887 HTTP/1.1" status: 200  len: 850 time: 0.0672305
Jun 01 06:19:26.673864 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-459de1de-0a20-4576-8eed-5921cbed5b8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:26.675364 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-459de1de-0a20-4576-8eed-5921cbed5b8d service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=028fef0a-f05a-48d5-ba5c-b539846209ba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0836647
Jun 01 06:19:26.772260 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:19:26.813589 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] No Port match for: 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:19:26.814240 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 8a7ac687-d801-4596-95ac-7b5a0bb4a7a7 not bound to the agent host hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:19:26.829858 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-d57fc7d7-50b5-4c07-b2ae-bb121dadf40e service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1470704
Jun 01 06:19:26.992957 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-eb6d964e-287f-4de6-80f9-41109e22b708 req-a20444f9-ed11-4bae-bac3-55be2ddeb281 service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1551695
Jun 01 06:19:27.117922 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1b3992e-016c-4ac3-9327-6387f8640a4b req-422e180e-f3ff-488f-910b-d230dd5eade6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:27.120126 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a1b3992e-016c-4ac3-9327-6387f8640a4b req-422e180e-f3ff-488f-910b-d230dd5eade6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 943 time: 0.0974138
Jun 01 06:19:27.226639 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a1b3992e-016c-4ac3-9327-6387f8640a4b req-c052b967-580f-462f-b4f2-4eaf212e7488 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0992393
Jun 01 06:19:27.280725 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 40586) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:27.405472 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-58a4a072-4374-461e-9a51-bbe27d408791 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:27.420212 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-58a4a072-4374-461e-9a51-bbe27d408791 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:19:27.424117 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-58a4a072-4374-461e-9a51-bbe27d408791 admin admin] Usage tracker for resource:security_group_rule and tenant:6313d470d91a415c9f44d940b98aad09 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:19:27.427021 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-58a4a072-4374-461e-9a51-bbe27d408791 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:19:27.433690 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-58a4a072-4374-461e-9a51-bbe27d408791 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:19:27.530694 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-58a4a072-4374-461e-9a51-bbe27d408791 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:27.535195 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-58a4a072-4374-461e-9a51-bbe27d408791 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:27.543034 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-e3af1740-76f2-442b-8cb6-e14c3bfd3ed3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:27.589856 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-58a4a072-4374-461e-9a51-bbe27d408791 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=6313d470d91a415c9f44d940b98aad09&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3079259
Jun 01 06:19:27.590798 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58a4a072-4374-461e-9a51-bbe27d408791 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=40bd506e-b04c-4ddc-81b7-b28537fa4ffd,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:27.592549 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 40610) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:27.593965 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-58a4a072-4374-461e-9a51-bbe27d408791 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:27.662926 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-dc618bae-97e8-41e9-8b45-3b372c234526 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:27.698175 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-dc618bae-97e8-41e9-8b45-3b372c234526 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:27.765248 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-dc618bae-97e8-41e9-8b45-3b372c234526 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:27.769176 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-0a374d42-6532-4db2-9632-7b9815936fe8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:27.783173 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc618bae-97e8-41e9-8b45-3b372c234526 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=40bd506e-b04c-4ddc-81b7-b28537fa4ffd,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:27.794376 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-dc618bae-97e8-41e9-8b45-3b372c234526 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:27.795454 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-dc618bae-97e8-41e9-8b45-3b372c234526 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:27.799532 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-dc618bae-97e8-41e9-8b45-3b372c234526 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/40bd506e-b04c-4ddc-81b7-b28537fa4ffd HTTP/1.1" status: 204  len: 168 time: 0.2049539
Jun 01 06:19:27.955730 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 40636) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:28.469890 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2277f9f9-623c-4d3f-b2a6-e25c190d7b77 req-2d79591e-fefa-482f-abda-78ed3b6d2a87 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:28.471481 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2277f9f9-623c-4d3f-b2a6-e25c190d7b77 req-2d79591e-fefa-482f-abda-78ed3b6d2a87 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 943 time: 0.1110725
Jun 01 06:19:28.531022 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2277f9f9-623c-4d3f-b2a6-e25c190d7b77 req-68a6919f-b80d-4dc1-83ea-ce50fb01b305 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0451920
Jun 01 06:19:28.609662 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0b253ecf-978c-454b-8772-8e4eaac3f116 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-744138'] for router_interface, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:29.182670 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-0b253ecf-978c-454b-8772-8e4eaac3f116 admin admin] Deleting port ac9595c2-fb73-47ad-a4a7-a8318ad01d8c {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:19:29.183002 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0b253ecf-978c-454b-8772-8e4eaac3f116 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:29.320383 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [None req-0b253ecf-978c-454b-8772-8e4eaac3f116 admin admin] For port ac9595c2-fb73-47ad-a4a7-a8318ad01d8c, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=ac9595c2-fb73-47ad-a4a7-a8318ad01d8c,segment=NetworkSegment(c40d74a4-eecc-4c63-8fd5-38ee39e77ccd),segment_id=c40d74a4-eecc-4c63-8fd5-38ee39e77ccd)] {{(pid=92230) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:19:29.320732 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0b253ecf-978c-454b-8772-8e4eaac3f116 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:29.461477 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-0b253ecf-978c-454b-8772-8e4eaac3f116 admin admin] Calling delete_port for ac9595c2-fb73-47ad-a4a7-a8318ad01d8c owned by network:router_interface {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:19:29.650380 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0b253ecf-978c-454b-8772-8e4eaac3f116 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:29.659866 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-379ff57d-7b82-4604-b21c-d86ee10e14e9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:29.757516 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac5716b8-9f61-4eeb-85ab-efba6c7a009a req-151230d9-19e4-4aff-8e7e-22e460b28f01 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:29.760237 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ac5716b8-9f61-4eeb-85ab-efba6c7a009a req-151230d9-19e4-4aff-8e7e-22e460b28f01 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 943 time: 0.0965724
Jun 01 06:19:29.798279 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b253ecf-978c-454b-8772-8e4eaac3f116 admin admin] Pushing event deleted for resources: {'Port': ['ID=ac9595c2-fb73-47ad-a4a7-a8318ad01d8c,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:29.818807 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-0b253ecf-978c-454b-8772-8e4eaac3f116 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:29.829938 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ac5716b8-9f61-4eeb-85ab-efba6c7a009a req-4a3c403f-fa18-4e77-80f4-e0227a045fa9 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0579369
Jun 01 06:19:30.092168 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-0b253ecf-978c-454b-8772-8e4eaac3f116 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-581113', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-746586'] for router_interface, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:30.481780 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0b253ecf-978c-454b-8772-8e4eaac3f116 admin admin] Router 4b9daac3-8875-4acd-af69-09a389effcf9 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92230) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:19:30.723226 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:19:30.823012 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0b253ecf-978c-454b-8772-8e4eaac3f116 admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:19:30.839203 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cfbf3265-b70d-4f84-8ead-78b9fa05e9e8 None None] Sync routers for ids ['4b9daac3-8875-4acd-af69-09a389effcf9'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:19:30.848344 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-0b253ecf-978c-454b-8772-8e4eaac3f116 admin admin] 10.222.0.25 "PUT /v2.0/routers/4b9daac3-8875-4acd-af69-09a389effcf9/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.8908839
Jun 01 06:19:30.849676 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cfbf3265-b70d-4f84-8ead-78b9fa05e9e8 None None] Routers {'4b9daac3-8875-4acd-af69-09a389effcf9'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:19:30.850299 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-cfbf3265-b70d-4f84-8ead-78b9fa05e9e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2530d30>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:19:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['4b9daac3-8875-4acd-af69-09a389effcf9'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:19:30.855405 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 40700) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:31.048275 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-cfbf3265-b70d-4f84-8ead-78b9fa05e9e8 None None] Set router 4b9daac3-8875-4acd-af69-09a389effcf9 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:19:31.051607 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4267df35-54d7-4c17-9266-21f6d1ae8de6 admin admin] Notify callbacks [] for router, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:31.142461 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6ae6fdc-5ff9-4121-aa3d-6bd19a442cb3 req-bf1e1aeb-e146-4679-adfc-5e0554fd71da tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:31.144028 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d6ae6fdc-5ff9-4121-aa3d-6bd19a442cb3 req-bf1e1aeb-e146-4679-adfc-5e0554fd71da tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 943 time: 0.1974161
Jun 01 06:19:31.200341 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d6ae6fdc-5ff9-4121-aa3d-6bd19a442cb3 req-ecd6fade-f696-4f54-a9b3-d95c326af3d8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0501506
Jun 01 06:19:31.235738 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4267df35-54d7-4c17-9266-21f6d1ae8de6 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:31.308405 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-4267df35-54d7-4c17-9266-21f6d1ae8de6 admin admin] Deleting port 7e398897-85c4-48cb-8059-cbb26d0f11bb {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:19:31.309054 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4267df35-54d7-4c17-9266-21f6d1ae8de6 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:31.356380 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-cfbf3265-b70d-4f84-8ead-78b9fa05e9e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2530d30>, [{'id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'name': 'tempest-TestMinimumBasicScenario-2100526911-router', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54'}], 'enable_snat': True}, 'gw_port_id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:15:55Z', 'updated_at': '2021-06-01T06:19:29Z', 'revision_number': 5, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'gw_port': {'id': '7e398897-85c4-48cb-8059-cbb26d0f11bb', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:aa:16:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:15:56Z', 'updated_at': '2021-06-01T06:16:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:19:31.360547 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cfbf3265-b70d-4f84-8ead-78b9fa05e9e8 None None] Checking router: 4b9daac3-8875-4acd-af69-09a389effcf9 for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:19:31.369123 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cfbf3265-b70d-4f84-8ead-78b9fa05e9e8 None None] Routers {'4b9daac3-8875-4acd-af69-09a389effcf9'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:19:31.369723 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-cfbf3265-b70d-4f84-8ead-78b9fa05e9e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2530d30>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:19:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['4b9daac3-8875-4acd-af69-09a389effcf9'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:19:31.438513 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [None req-4267df35-54d7-4c17-9266-21f6d1ae8de6 admin admin] For port 7e398897-85c4-48cb-8059-cbb26d0f11bb, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=7e398897-85c4-48cb-8059-cbb26d0f11bb,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92230) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:19:31.438990 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4267df35-54d7-4c17-9266-21f6d1ae8de6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:31.523370 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-cfbf3265-b70d-4f84-8ead-78b9fa05e9e8 None None] Set router 4b9daac3-8875-4acd-af69-09a389effcf9 gateway port host: None {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:19:31.572160 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-4267df35-54d7-4c17-9266-21f6d1ae8de6 admin admin] Calling delete_port for 7e398897-85c4-48cb-8059-cbb26d0f11bb owned by network:router_gateway {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:19:31.632039 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-cfbf3265-b70d-4f84-8ead-78b9fa05e9e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2530d30>, [{'id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'name': 'tempest-TestMinimumBasicScenario-2100526911-router', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:15:55Z', 'updated_at': '2021-06-01T06:19:31Z', 'revision_number': 6, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'gw_port_host': None}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:19:31.637576 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cfbf3265-b70d-4f84-8ead-78b9fa05e9e8 None None] The sync data for ids ['4b9daac3-8875-4acd-af69-09a389effcf9'] in dv-cinder-793885-1-iscsi is: [{'id': '4b9daac3-8875-4acd-af69-09a389effcf9', 'name': 'tempest-TestMinimumBasicScenario-2100526911-router', 'tenant_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:15:55Z', 'updated_at': '2021-06-01T06:19:31Z', 'revision_number': 6, 'project_id': 'c0ca2b878b874fe4af6e7b9fa8f6cf59', 'gw_port_host': None}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:19:31.760407 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4267df35-54d7-4c17-9266-21f6d1ae8de6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:31.765075 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-51a62a04-8b77-426a-9d07-64073d477c0d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:31.817340 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4267df35-54d7-4c17-9266-21f6d1ae8de6 admin admin] Pushing event deleted for resources: {'Port': ['ID=7e398897-85c4-48cb-8059-cbb26d0f11bb,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:31.819640 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-4267df35-54d7-4c17-9266-21f6d1ae8de6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:31.925326 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4267df35-54d7-4c17-9266-21f6d1ae8de6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-745687'] for router_gateway, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:32.130424 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4267df35-54d7-4c17-9266-21f6d1ae8de6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-748122', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-727'] for router, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:32.132718 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4267df35-54d7-4c17-9266-21f6d1ae8de6 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:32.160274 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4267df35-54d7-4c17-9266-21f6d1ae8de6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-746854'] for router, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:32.161012 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4267df35-54d7-4c17-9266-21f6d1ae8de6 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4b9daac3-8875-4acd-af69-09a389effcf9 {{(pid=92230) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 06:19:32.179380 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-4267df35-54d7-4c17-9266-21f6d1ae8de6 admin admin] Notify callbacks [] for router, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:32.182894 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-4267df35-54d7-4c17-9266-21f6d1ae8de6 admin admin] 10.222.0.25 "DELETE /v2.0/routers/4b9daac3-8875-4acd-af69-09a389effcf9 HTTP/1.1" status: 204  len: 168 time: 1.3239393
Jun 01 06:19:32.184169 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 40760) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:32.250750 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_v2 [None req-a256e0e2-17b1-496d-9de4-6afbe606a06a admin admin] Deleting subnet 27e7a9e0-ab4e-478c-aff2-55a26159dc84 {{(pid=92230) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 06:19:32.254227 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a256e0e2-17b1-496d-9de4-6afbe606a06a admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:32.412131 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-136ef144-b789-4dc9-8ee5-eb86bb2c5dd3 req-99ec1379-8e9d-40c2-9f34-2517aa1ad3cc tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:32.428275 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-136ef144-b789-4dc9-8ee5-eb86bb2c5dd3 req-99ec1379-8e9d-40c2-9f34-2517aa1ad3cc tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 943 time: 0.1134624
Jun 01 06:19:32.450291 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a256e0e2-17b1-496d-9de4-6afbe606a06a admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2178887'] for subnet, precommit_delete_associations {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:32.506057 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-136ef144-b789-4dc9-8ee5-eb86bb2c5dd3 req-3a7d1c72-8cfe-4475-b74e-5341375bee2f tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0762088
Jun 01 06:19:32.537098 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device ac9595c2-fb73-47ad-a4a7-a8318ad01d8c no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:19:32.574334 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a256e0e2-17b1-496d-9de4-6afbe606a06a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8086245'] for subnet, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:32.577959 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: ac9595c2-fb73-47ad-a4a7-a8318ad01d8c {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:19:32.578389 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device ac9595c2-fb73-47ad-a4a7-a8318ad01d8c not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:19:32.579221 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 7e398897-85c4-48cb-8059-cbb26d0f11bb no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:19:32.621224 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: 7e398897-85c4-48cb-8059-cbb26d0f11bb {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:19:32.621662 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 7e398897-85c4-48cb-8059-cbb26d0f11bb not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:19:32.860873 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a256e0e2-17b1-496d-9de4-6afbe606a06a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8087120', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2445502', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1981527'] for subnet, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:32.865043 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:32.897972 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a256e0e2-17b1-496d-9de4-6afbe606a06a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=27e7a9e0-ab4e-478c-aff2-55a26159dc84,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:32.904159 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-a256e0e2-17b1-496d-9de4-6afbe606a06a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:32.907061 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a256e0e2-17b1-496d-9de4-6afbe606a06a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:32.913113 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-a256e0e2-17b1-496d-9de4-6afbe606a06a admin admin] 10.222.0.25 "DELETE /v2.0/subnets/27e7a9e0-ab4e-478c-aff2-55a26159dc84 HTTP/1.1" status: 204  len: 168 time: 0.7288013
Jun 01 06:19:32.916343 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 40774) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:32.918090 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5b9054d-49cb-4047-b149-176f9660beca None None] Network d36c4486-6b2d-4439-996b-f13c04a98cb8 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:19:33.042784 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3492a9db-5919-43e4-bd93-c7b386799347 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8063377'] for network, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:33.141798 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [None req-3492a9db-5919-43e4-bd93-c7b386799347 admin admin] Deleting port 2b49e407-7abc-4d33-9700-d1d6a09de31a {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:19:33.142308 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3492a9db-5919-43e4-bd93-c7b386799347 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:33.217939 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ba09e15-71b4-4129-8ea5-0c1988351361 None None] DHCP port deletion for d36c4486-6b2d-4439-996b-f13c04a98cb8 request from dv-cinder-793885-1-iscsi {{(pid=92231) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 06:19:33.263931 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [None req-3492a9db-5919-43e4-bd93-c7b386799347 admin admin] For port 2b49e407-7abc-4d33-9700-d1d6a09de31a, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=2b49e407-7abc-4d33-9700-d1d6a09de31a,segment=NetworkSegment(c40d74a4-eecc-4c63-8fd5-38ee39e77ccd),segment_id=c40d74a4-eecc-4c63-8fd5-38ee39e77ccd)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:19:33.264292 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3492a9db-5919-43e4-bd93-c7b386799347 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:33.300441 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-0ba09e15-71b4-4129-8ea5-0c1988351361 None None] Deleting port 2b49e407-7abc-4d33-9700-d1d6a09de31a {{(pid=92231) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:19:33.300825 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-0ba09e15-71b4-4129-8ea5-0c1988351361 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:33.422144 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [None req-3492a9db-5919-43e4-bd93-c7b386799347 admin admin] Calling delete_port for 2b49e407-7abc-4d33-9700-d1d6a09de31a owned by network:dhcp {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:19:33.445263 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-0ba09e15-71b4-4129-8ea5-0c1988351361 None None] For port 2b49e407-7abc-4d33-9700-d1d6a09de31a, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=2b49e407-7abc-4d33-9700-d1d6a09de31a,segment=NetworkSegment(c40d74a4-eecc-4c63-8fd5-38ee39e77ccd),segment_id=c40d74a4-eecc-4c63-8fd5-38ee39e77ccd)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:19:33.445668 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-0ba09e15-71b4-4129-8ea5-0c1988351361 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:33.471302 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3492a9db-5919-43e4-bd93-c7b386799347 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:33.478213 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-0b8d1c69-374c-49ea-a401-f15fabe5357a tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:33.533812 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3492a9db-5919-43e4-bd93-c7b386799347 admin admin] Pushing event deleted for resources: {'Port': ['ID=2b49e407-7abc-4d33-9700-d1d6a09de31a,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:33.537094 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-3492a9db-5919-43e4-bd93-c7b386799347 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:33.540985 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3492a9db-5919-43e4-bd93-c7b386799347 admin admin] No DVR routers for this DVR port 2b49e407-7abc-4d33-9700-d1d6a09de31a on host dv-cinder-793885-1-iscsi {{(pid=92229) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:19:33.583934 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-0ba09e15-71b4-4129-8ea5-0c1988351361 None None] Calling delete_port for 2b49e407-7abc-4d33-9700-d1d6a09de31a owned by network:dhcp {{(pid=92231) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:19:33.629748 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-0ba09e15-71b4-4129-8ea5-0c1988351361 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756'] for port, after_delete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:33.640309 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:33.679675 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ba09e15-71b4-4129-8ea5-0c1988351361 None None] No DVR routers for this DVR port 2b49e407-7abc-4d33-9700-d1d6a09de31a on host dv-cinder-793885-1-iscsi {{(pid=92231) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:19:33.688733 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ba09e15-71b4-4129-8ea5-0c1988351361 None None] Pushing event deleted for resources: {'Port': ['ID=2b49e407-7abc-4d33-9700-d1d6a09de31a,revision_number=None']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:33.695089 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-0ba09e15-71b4-4129-8ea5-0c1988351361 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:33.722150 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3492a9db-5919-43e4-bd93-c7b386799347 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8093290', 'neutron.services.segments.db._delete_segments_for_network-8788497006300'] for network, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:33.741326 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-3492a9db-5919-43e4-bd93-c7b386799347 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe3b09da8b0>,) {'filters': {'network_id': ['d36c4486-6b2d-4439-996b-f13c04a98cb8']}} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:19:33.756937 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-3492a9db-5919-43e4-bd93-c7b386799347 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b09da8b0>, 'c40d74a4-eecc-4c63-8fd5-38ee39e77ccd') {'for_net_delete': True} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:19:33.757225 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-3492a9db-5919-43e4-bd93-c7b386799347 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b09da8b0>, 'c40d74a4-eecc-4c63-8fd5-38ee39e77ccd') {} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:19:33.772059 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3492a9db-5919-43e4-bd93-c7b386799347 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8788497014941', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2127091'] for segment, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:33.793779 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3492a9db-5919-43e4-bd93-c7b386799347 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:33.802401 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3492a9db-5919-43e4-bd93-c7b386799347 admin admin] Releasing vlan 221 on physical network physnet1 to pool {{(pid=92229) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 06:19:33.802819 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3492a9db-5919-43e4-bd93-c7b386799347 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2077367'] for segment, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]: Traceback (most recent call last):
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:     timer()
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:     cb(*args, **kw)
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:     return func(*args, **kwargs)
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:     self._notify()
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:     self.callback(batched_events)
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:     event.method(event)
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:     return f(self, *a, **k)
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self._get(url).json()
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self.request(url, 'GET', **kwargs)
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 06:19:33.819441 dv-cinder-793885-1-iscsi neutron-server[92229]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 06:19:33.832585 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31a6feb7-cd58-4655-84e9-09f3f46e7969 req-715b6da0-f87e-415a-b564-502c23f4558d tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:33.834023 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-31a6feb7-cd58-4655-84e9-09f3f46e7969 req-715b6da0-f87e-415a-b564-502c23f4558d tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 943 time: 0.1693823
Jun 01 06:19:33.925947 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3492a9db-5919-43e4-bd93-c7b386799347 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8093283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-745674'] for network, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:33.934660 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-3492a9db-5919-43e4-bd93-c7b386799347 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:33.940132 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-3f63c8f8-c445-478a-aa6b-13398fb7004d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:33.961225 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-31a6feb7-cd58-4655-84e9-09f3f46e7969 req-5ef5da4f-64a2-4bcb-a586-8bb13a7b42b7 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0842302
Jun 01 06:19:33.971817 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3492a9db-5919-43e4-bd93-c7b386799347 admin admin] Pushing event deleted for resources: {'Network': ['ID=d36c4486-6b2d-4439-996b-f13c04a98cb8,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:33.976173 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-3492a9db-5919-43e4-bd93-c7b386799347 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:33.979519 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-3492a9db-5919-43e4-bd93-c7b386799347 admin admin] 10.222.0.25 "DELETE /v2.0/networks/d36c4486-6b2d-4439-996b-f13c04a98cb8 HTTP/1.1" status: 204  len: 168 time: 1.0620751
Jun 01 06:19:33.982413 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 40796) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:34.264874 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 2b49e407-7abc-4d33-9700-d1d6a09de31a no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:19:34.302396 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: 2b49e407-7abc-4d33-9700-d1d6a09de31a {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:19:34.302740 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 2b49e407-7abc-4d33-9700-d1d6a09de31a not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:19:34.693265 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4bb08104-8e31-4abe-b9cd-8102ba7929c4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-744138'] for router_interface, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:34.815979 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 5fa581a1-474d-4dc6-a414-36e7324b8555 details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:19:34.992855 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 5fa581a1-474d-4dc6-a414-36e7324b8555, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=5fa581a1-474d-4dc6-a414-36e7324b8555,segment=NetworkSegment(e9a368be-e119-4f56-bdcc-b9d10543e0d8),segment_id=e9a368be-e119-4f56-bdcc-b9d10543e0d8)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:19:35.017377 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': '5fa581a1-474d-4dc6-a414-36e7324b8555', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'port_id': '5fa581a1-474d-4dc6-a414-36e7324b8555', 'mac_address': 'fa:16:3e:ee:45:0a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 209, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:19:35.075855 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:35.108598 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5fa581a1-474d-4dc6-a414-36e7324b8555 {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:19:35.125705 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 5fa581a1-474d-4dc6-a414-36e7324b8555, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=5fa581a1-474d-4dc6-a414-36e7324b8555,segment=NetworkSegment(e9a368be-e119-4f56-bdcc-b9d10543e0d8),segment_id=e9a368be-e119-4f56-bdcc-b9d10543e0d8)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:19:35.130308 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:35.132388 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:35.206749 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=5fa581a1-474d-4dc6-a414-36e7324b8555,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:35.210944 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:35.238584 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8061317c-656f-4a81-bdbf-18dcfe052020 req-b47d4993-41d3-4183-a71f-10e6536768bd tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:35.240093 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8061317c-656f-4a81-bdbf-18dcfe052020 req-b47d4993-41d3-4183-a71f-10e6536768bd tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 944 time: 0.1508200
Jun 01 06:19:35.246312 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [None req-4bb08104-8e31-4abe-b9cd-8102ba7929c4 admin admin] Deleting port 79a126cb-af44-4fd1-9f46-1de4e1ad9f55 {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:19:35.246564 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4bb08104-8e31-4abe-b9cd-8102ba7929c4 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:35.342943 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['5fa581a1-474d-4dc6-a414-36e7324b8555'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:19:35.375629 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8061317c-656f-4a81-bdbf-18dcfe052020 req-01c46bf4-a3b5-43e2-9a2c-38dbba229844 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1125245
Jun 01 06:19:35.413418 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [None req-4bb08104-8e31-4abe-b9cd-8102ba7929c4 admin admin] For port 79a126cb-af44-4fd1-9f46-1de4e1ad9f55, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=79a126cb-af44-4fd1-9f46-1de4e1ad9f55,segment=NetworkSegment(7f505287-cd09-4e79-b15f-b1cfa1fb5101),segment_id=7f505287-cd09-4e79-b15f-b1cfa1fb5101)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:19:35.413774 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4bb08104-8e31-4abe-b9cd-8102ba7929c4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:35.541703 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [None req-4bb08104-8e31-4abe-b9cd-8102ba7929c4 admin admin] Calling delete_port for 79a126cb-af44-4fd1-9f46-1de4e1ad9f55 owned by network:router_interface {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:19:35.708998 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4bb08104-8e31-4abe-b9cd-8102ba7929c4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:35.714396 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ae309482-31d3-4fab-97f0-edee900645c8 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:35.760230 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bb08104-8e31-4abe-b9cd-8102ba7929c4 admin admin] Pushing event deleted for resources: {'Port': ['ID=79a126cb-af44-4fd1-9f46-1de4e1ad9f55,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:35.793920 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-4bb08104-8e31-4abe-b9cd-8102ba7929c4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:36.061811 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4bb08104-8e31-4abe-b9cd-8102ba7929c4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-581113', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-746586'] for router_interface, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:36.632162 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4bb08104-8e31-4abe-b9cd-8102ba7929c4 admin admin] Router 5259b64a-6ad9-47e2-a600-f8c700202c34 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92229) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:19:36.726845 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b24b9cff-c85b-436d-858b-c3ab2f878fb2 req-ce2e37fc-a2b9-4db6-a16c-ed766af0d571 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:36.728835 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b24b9cff-c85b-436d-858b-c3ab2f878fb2 req-ce2e37fc-a2b9-4db6-a16c-ed766af0d571 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 944 time: 0.1987314
Jun 01 06:19:36.820698 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 5fa581a1-474d-4dc6-a414-36e7324b8555 up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:19:36.863225 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b24b9cff-c85b-436d-858b-c3ab2f878fb2 req-91642277-a25d-40e9-b58f-1f3c70591bbc tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1249418
Jun 01 06:19:36.882114 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4bb08104-8e31-4abe-b9cd-8102ba7929c4 admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92229) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:19:36.892327 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ec5462e-b60a-4376-b092-2acc77ce220f None None] Sync routers for ids ['5259b64a-6ad9-47e2-a600-f8c700202c34'] in dv-cinder-793885-1-iscsi {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:19:36.895481 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning for port 5fa581a1-474d-4dc6-a414-36e7324b8555 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:19:36.902037 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port 5fa581a1-474d-4dc6-a414-36e7324b8555 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:19:36.902419 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:36.904038 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ec5462e-b60a-4376-b092-2acc77ce220f None None] Routers {'5259b64a-6ad9-47e2-a600-f8c700202c34'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:19:36.904494 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-4bb08104-8e31-4abe-b9cd-8102ba7929c4 admin admin] 10.222.0.25 "PUT /v2.0/routers/5259b64a-6ad9-47e2-a600-f8c700202c34/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.9210596
Jun 01 06:19:36.904859 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 40844) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:36.905867 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-0ec5462e-b60a-4376-b092-2acc77ce220f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2643af0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:19:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['5259b64a-6ad9-47e2-a600-f8c700202c34'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:19:37.037838 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:37.069283 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'af5f753c-f6ea-450a-ac47-3802c6b16eb3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5fa581a1-474d-4dc6-a414-36e7324b8555'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:19:37.072483 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-69653046-12f3-4848-8b82-975ba17bba5f" -d '{"events": [{"server_uuid": "af5f753c-f6ea-450a-ac47-3802c6b16eb3", "name": "network-vif-plugged", "status": "completed", "tag": "5fa581a1-474d-4dc6-a414-36e7324b8555"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:19:37.096199 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 5fa581a1-474d-4dc6-a414-36e7324b8555, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=5fa581a1-474d-4dc6-a414-36e7324b8555,segment=NetworkSegment(e9a368be-e119-4f56-bdcc-b9d10543e0d8),segment_id=e9a368be-e119-4f56-bdcc-b9d10543e0d8)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:19:37.105330 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:37.105545 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b56c4a5c-09d3-4297-8950-1730f156e7c8 admin admin] Notify callbacks [] for router, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:37.108831 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:37.132740 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-0ec5462e-b60a-4376-b092-2acc77ce220f None None] Set router 5259b64a-6ad9-47e2-a600-f8c700202c34 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:19:37.188978 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:19:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-692ed0ec-4a7e-4f93-8dde-4be6a43c825a x-openstack-request-id: req-692ed0ec-4a7e-4f93-8dde-4be6a43c825a {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:19:37.189549 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "af5f753c-f6ea-450a-ac47-3802c6b16eb3", "name": "network-vif-plugged", "status": "completed", "tag": "5fa581a1-474d-4dc6-a414-36e7324b8555", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:19:37.189968 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-692ed0ec-4a7e-4f93-8dde-4be6a43c825a {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:19:37.190921 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'af5f753c-f6ea-450a-ac47-3802c6b16eb3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5fa581a1-474d-4dc6-a414-36e7324b8555', 'code': 200}
Jun 01 06:19:37.215295 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=5fa581a1-474d-4dc6-a414-36e7324b8555,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:37.228660 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:37.307769 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b56c4a5c-09d3-4297-8950-1730f156e7c8 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:37.396365 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-b56c4a5c-09d3-4297-8950-1730f156e7c8 admin admin] Deleting port 2f756d86-5bac-4927-ae20-b147143147c2 {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:19:37.396798 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b56c4a5c-09d3-4297-8950-1730f156e7c8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:37.498136 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1a3b4f3-f645-47d5-83e7-9da591b537b2 req-b63bf9b8-f1b8-4d6d-88aa-397cd6b9da30 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:37.501143 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e1a3b4f3-f645-47d5-83e7-9da591b537b2 req-b63bf9b8-f1b8-4d6d-88aa-397cd6b9da30 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 1098 time: 0.0828514
Jun 01 06:19:37.502031 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-0ec5462e-b60a-4376-b092-2acc77ce220f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2643af0>, [{'id': '5259b64a-6ad9-47e2-a600-f8c700202c34', 'name': 'tempest-TestMinimumBasicScenario-99861397-router', 'tenant_id': '43f56027f58d47f5b11d46a512f3e137', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.188'}], 'enable_snat': True}, 'gw_port_id': '2f756d86-5bac-4927-ae20-b147143147c2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:16:06Z', 'updated_at': '2021-06-01T06:19:35Z', 'revision_number': 5, 'project_id': '43f56027f58d47f5b11d46a512f3e137', 'gw_port': {'id': '2f756d86-5bac-4927-ae20-b147143147c2', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:0b:67:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5259b64a-6ad9-47e2-a600-f8c700202c34', 'device_owner': 'network:router_gateway', 'standard_attr_id': 555, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.188', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:16:08Z', 'updated_at': '2021-06-01T06:16:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:19:37.506105 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ec5462e-b60a-4376-b092-2acc77ce220f None None] Checking router: 5259b64a-6ad9-47e2-a600-f8c700202c34 for host: dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:19:37.517634 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ec5462e-b60a-4376-b092-2acc77ce220f None None] Routers {'5259b64a-6ad9-47e2-a600-f8c700202c34'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:19:37.521783 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-0ec5462e-b60a-4376-b092-2acc77ce220f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2643af0>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:19:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['5259b64a-6ad9-47e2-a600-f8c700202c34'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:19:37.525866 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 40856) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:37.551955 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [None req-b56c4a5c-09d3-4297-8950-1730f156e7c8 admin admin] For port 2f756d86-5bac-4927-ae20-b147143147c2, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=2f756d86-5bac-4927-ae20-b147143147c2,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92230) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:19:37.552390 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b56c4a5c-09d3-4297-8950-1730f156e7c8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:37.566268 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e1a3b4f3-f645-47d5-83e7-9da591b537b2 req-170cc34e-1ecd-4bfc-a4f8-d0ad43af70af service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0589020
Jun 01 06:19:37.677036 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7f2d45c4-63c2-4c5a-b22a-1d685ead2f29 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:37.681557 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-b56c4a5c-09d3-4297-8950-1730f156e7c8 admin admin] Calling delete_port for 2f756d86-5bac-4927-ae20-b147143147c2 owned by network:router_gateway {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:19:37.683831 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-0ec5462e-b60a-4376-b092-2acc77ce220f None None] Set router 5259b64a-6ad9-47e2-a600-f8c700202c34 gateway port host: None {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:19:37.693733 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-7f2d45c4-63c2-4c5a-b22a-1d685ead2f29 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:19:37.697724 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-7f2d45c4-63c2-4c5a-b22a-1d685ead2f29 admin admin] Usage tracker for resource:security_group_rule and tenant:b9ca68d83c224914adec28cb963354f7 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:19:37.700639 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-7f2d45c4-63c2-4c5a-b22a-1d685ead2f29 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:19:37.707180 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-7f2d45c4-63c2-4c5a-b22a-1d685ead2f29 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:19:37.808444 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-0ec5462e-b60a-4376-b092-2acc77ce220f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2643af0>, [{'id': '5259b64a-6ad9-47e2-a600-f8c700202c34', 'name': 'tempest-TestMinimumBasicScenario-99861397-router', 'tenant_id': '43f56027f58d47f5b11d46a512f3e137', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:16:06Z', 'updated_at': '2021-06-01T06:19:37Z', 'revision_number': 6, 'project_id': '43f56027f58d47f5b11d46a512f3e137', 'gw_port_host': None}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:19:37.813029 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ec5462e-b60a-4376-b092-2acc77ce220f None None] The sync data for ids ['5259b64a-6ad9-47e2-a600-f8c700202c34'] in dv-cinder-793885-1-iscsi is: [{'id': '5259b64a-6ad9-47e2-a600-f8c700202c34', 'name': 'tempest-TestMinimumBasicScenario-99861397-router', 'tenant_id': '43f56027f58d47f5b11d46a512f3e137', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:16:06Z', 'updated_at': '2021-06-01T06:19:37Z', 'revision_number': 6, 'project_id': '43f56027f58d47f5b11d46a512f3e137', 'gw_port_host': None}] {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:19:37.826935 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7f2d45c4-63c2-4c5a-b22a-1d685ead2f29 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:37.834076 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-7f2d45c4-63c2-4c5a-b22a-1d685ead2f29 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:37.847925 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-9102eed3-f60c-4382-8aec-e95f5b186b4a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:37.861526 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b56c4a5c-09d3-4297-8950-1730f156e7c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:37.866882 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-ff335e30-78e2-44f9-9d7e-5c7401f9eacb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:37.895511 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-7f2d45c4-63c2-4c5a-b22a-1d685ead2f29 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=b9ca68d83c224914adec28cb963354f7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3670595
Jun 01 06:19:37.897225 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f2d45c4-63c2-4c5a-b22a-1d685ead2f29 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c1fd291f-8668-4b72-b817-536b423e2e04,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:37.900065 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 40872) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:37.949449 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b56c4a5c-09d3-4297-8950-1730f156e7c8 admin admin] Pushing event deleted for resources: {'Port': ['ID=2f756d86-5bac-4927-ae20-b147143147c2,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:37.952392 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-b56c4a5c-09d3-4297-8950-1730f156e7c8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:37.956651 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2d45c4-63c2-4c5a-b22a-1d685ead2f29 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:19:37.957031 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2d45c4-63c2-4c5a-b22a-1d685ead2f29 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:19:37.957431 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2d45c4-63c2-4c5a-b22a-1d685ead2f29 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:19:37.957791 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2d45c4-63c2-4c5a-b22a-1d685ead2f29 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:19:37.958215 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2d45c4-63c2-4c5a-b22a-1d685ead2f29 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:19:37.958575 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2d45c4-63c2-4c5a-b22a-1d685ead2f29 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:19:37.958928 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2d45c4-63c2-4c5a-b22a-1d685ead2f29 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:19:37.959277 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2d45c4-63c2-4c5a-b22a-1d685ead2f29 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:19:37.959626 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2d45c4-63c2-4c5a-b22a-1d685ead2f29 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:19:37.959990 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2d45c4-63c2-4c5a-b22a-1d685ead2f29 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:19:37.960359 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2d45c4-63c2-4c5a-b22a-1d685ead2f29 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:19:37.960672 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7f2d45c4-63c2-4c5a-b22a-1d685ead2f29 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:19:37.965832 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-7f2d45c4-63c2-4c5a-b22a-1d685ead2f29 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:37.991123 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-642ac09c-f304-4ec4-ab9f-a59c3df8f369 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:38.020175 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-642ac09c-f304-4ec4-ab9f-a59c3df8f369 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:38.027019 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b56c4a5c-09d3-4297-8950-1730f156e7c8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-745687'] for router_gateway, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:38.139624 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf896790-4525-4260-9002-f918c60771de req-b4507075-5c97-48cf-a32a-fc8ec84616dc tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:38.141104 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cf896790-4525-4260-9002-f918c60771de req-b4507075-5c97-48cf-a32a-fc8ec84616dc tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 945 time: 0.1134140
Jun 01 06:19:38.151028 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-642ac09c-f304-4ec4-ab9f-a59c3df8f369 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:38.156564 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 40878) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:38.157419 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b5f60870-ce64-4c01-a683-862441fb77bb tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:38.193465 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-642ac09c-f304-4ec4-ab9f-a59c3df8f369 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c1fd291f-8668-4b72-b817-536b423e2e04,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:38.205508 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-642ac09c-f304-4ec4-ab9f-a59c3df8f369 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:38.206413 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-642ac09c-f304-4ec4-ab9f-a59c3df8f369 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:38.207519 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-642ac09c-f304-4ec4-ab9f-a59c3df8f369 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/c1fd291f-8668-4b72-b817-536b423e2e04 HTTP/1.1" status: 204  len: 168 time: 0.3065808
Jun 01 06:19:38.276709 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cf896790-4525-4260-9002-f918c60771de req-642b77a8-c3ba-4fb3-b6dd-05020b573908 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1208870
Jun 01 06:19:38.369967 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-7a0f0572-45eb-42d7-8822-18e9f09c5df3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:38.447569 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-0d2b03e2-8531-40ab-b8f5-cc46334fb3a7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:38.464864 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b56c4a5c-09d3-4297-8950-1730f156e7c8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-748122', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-727'] for router, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:38.468870 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b56c4a5c-09d3-4297-8950-1730f156e7c8 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:38.475566 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-0d2b03e2-8531-40ab-b8f5-cc46334fb3a7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:19:38.490092 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-0d2b03e2-8531-40ab-b8f5-cc46334fb3a7 admin admin] Usage tracker for resource:security_group_rule and tenant:e5e26d44f7ba4f2cb8fede5a28537801 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:19:38.498977 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-0d2b03e2-8531-40ab-b8f5-cc46334fb3a7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:19:38.510264 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b56c4a5c-09d3-4297-8950-1730f156e7c8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-746854'] for router, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:38.511075 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b56c4a5c-09d3-4297-8950-1730f156e7c8 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 5259b64a-6ad9-47e2-a600-f8c700202c34 {{(pid=92230) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 06:19:38.511296 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-0d2b03e2-8531-40ab-b8f5-cc46334fb3a7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:19:38.532744 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b56c4a5c-09d3-4297-8950-1730f156e7c8 admin admin] Notify callbacks [] for router, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:38.534307 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-b56c4a5c-09d3-4297-8950-1730f156e7c8 admin admin] 10.222.0.25 "DELETE /v2.0/routers/5259b64a-6ad9-47e2-a600-f8c700202c34 HTTP/1.1" status: 204  len: 168 time: 1.6281440
Jun 01 06:19:38.539024 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 40888) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:38.614314 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_v2 [None req-c81b647f-4cba-4e9d-979c-5db982db2570 admin admin] Deleting subnet c9393913-0a82-467c-b1f7-1525ee7c2eb7 {{(pid=92230) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 06:19:38.617764 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-c81b647f-4cba-4e9d-979c-5db982db2570 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:38.673259 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-c81b647f-4cba-4e9d-979c-5db982db2570 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2178887'] for subnet, precommit_delete_associations {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:38.674540 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-0d2b03e2-8531-40ab-b8f5-cc46334fb3a7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:38.681515 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-0d2b03e2-8531-40ab-b8f5-cc46334fb3a7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:38.696074 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-1631709f-ca9c-46c3-b1a9-efeb6305f954 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:38.712601 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 79a126cb-af44-4fd1-9f46-1de4e1ad9f55 no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:19:38.751219 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-0d2b03e2-8531-40ab-b8f5-cc46334fb3a7 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=e5e26d44f7ba4f2cb8fede5a28537801&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5862701
Jun 01 06:19:38.752888 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 40892) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:38.754680 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: 79a126cb-af44-4fd1-9f46-1de4e1ad9f55 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:19:38.755035 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 79a126cb-af44-4fd1-9f46-1de4e1ad9f55 not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:19:38.755768 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d2b03e2-8531-40ab-b8f5-cc46334fb3a7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c30f0b0-2c6f-4115-9474-6a52d908cb85,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:38.758871 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-0d2b03e2-8531-40ab-b8f5-cc46334fb3a7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:38.806808 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-c81b647f-4cba-4e9d-979c-5db982db2570 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8086245'] for subnet, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:38.891482 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d1ba82eb-ce0c-4663-a8fd-76b59f614ba1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:38.992782 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d1ba82eb-ce0c-4663-a8fd-76b59f614ba1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:39.130187 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d1ba82eb-ce0c-4663-a8fd-76b59f614ba1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:39.136907 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-d63af1c8-cfb8-4539-8935-489f97e72e1d tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:39.155170 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1ba82eb-ce0c-4663-a8fd-76b59f614ba1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c30f0b0-2c6f-4115-9474-6a52d908cb85,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:39.159648 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-d1ba82eb-ce0c-4663-a8fd-76b59f614ba1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:39.168826 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d1ba82eb-ce0c-4663-a8fd-76b59f614ba1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:39.169953 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-d1ba82eb-ce0c-4663-a8fd-76b59f614ba1 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/5c30f0b0-2c6f-4115-9474-6a52d908cb85 HTTP/1.1" status: 204  len: 168 time: 0.4159439
Jun 01 06:19:39.187601 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-c81b647f-4cba-4e9d-979c-5db982db2570 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8087120', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2445502', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1981527'] for subnet, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:39.199994 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:39.238349 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c81b647f-4cba-4e9d-979c-5db982db2570 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c9393913-0a82-467c-b1f7-1525ee7c2eb7,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:39.240479 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-c81b647f-4cba-4e9d-979c-5db982db2570 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:39.243522 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-c81b647f-4cba-4e9d-979c-5db982db2570 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:39.246576 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8d8ce94-cd2e-4f9a-ae4d-c50f8a91f3b3 None None] Network a62a4246-c7f6-49f1-8116-df3533b6b298 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:19:39.250749 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 40898) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:39.251699 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-c81b647f-4cba-4e9d-979c-5db982db2570 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/c9393913-0a82-467c-b1f7-1525ee7c2eb7 HTTP/1.1" status: 204  len: 168 time: 0.7093673
Jun 01 06:19:39.391483 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8063377'] for network, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:39.536743 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8050996a-0e7d-43a0-956f-503b11ced104 None None] DHCP port deletion for a62a4246-c7f6-49f1-8116-df3533b6b298 request from dv-cinder-793885-1-iscsi {{(pid=92231) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 06:19:39.543717 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] Deleting port 81d48392-f948-43df-923d-bb60ae00642d {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:19:39.544130 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:39.567970 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87ea046e-56e2-43dc-96a4-1de5f0741d62 req-5f5279a8-99ee-4395-b277-18e995591a87 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:39.569797 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-87ea046e-56e2-43dc-96a4-1de5f0741d62 req-5f5279a8-99ee-4395-b277-18e995591a87 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 945 time: 0.1324735
Jun 01 06:19:39.626275 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 40906) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:39.632588 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-8050996a-0e7d-43a0-956f-503b11ced104 None None] Deleting port 81d48392-f948-43df-923d-bb60ae00642d {{(pid=92231) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:19:39.633168 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-8050996a-0e7d-43a0-956f-503b11ced104 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:39.655285 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-dedb0639-c0a1-4e04-9859-4f6d83e8abb3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:39.673960 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-dedb0639-c0a1-4e04-9859-4f6d83e8abb3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:19:39.679996 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-dedb0639-c0a1-4e04-9859-4f6d83e8abb3 admin admin] Usage tracker for resource:security_group_rule and tenant:379964a88bd341a29879ed8f68f23e80 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:19:39.684221 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-dedb0639-c0a1-4e04-9859-4f6d83e8abb3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:19:39.692099 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-dedb0639-c0a1-4e04-9859-4f6d83e8abb3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:19:39.803130 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-8050996a-0e7d-43a0-956f-503b11ced104 None None] For port 81d48392-f948-43df-923d-bb60ae00642d, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=81d48392-f948-43df-923d-bb60ae00642d,segment=NetworkSegment(7f505287-cd09-4e79-b15f-b1cfa1fb5101),segment_id=7f505287-cd09-4e79-b15f-b1cfa1fb5101)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:19:39.803524 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-8050996a-0e7d-43a0-956f-503b11ced104 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:39.812745 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-dedb0639-c0a1-4e04-9859-4f6d83e8abb3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:39.815859 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] For port 81d48392-f948-43df-923d-bb60ae00642d, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=81d48392-f948-43df-923d-bb60ae00642d,segment=NetworkSegment(7f505287-cd09-4e79-b15f-b1cfa1fb5101),segment_id=7f505287-cd09-4e79-b15f-b1cfa1fb5101)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:19:39.816231 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:39.817693 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-dedb0639-c0a1-4e04-9859-4f6d83e8abb3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:39.826864 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-87ea046e-56e2-43dc-96a4-1de5f0741d62 req-0e21a1ad-45e0-4be2-ae67-45360586179d tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2012603
Jun 01 06:19:39.828379 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e85143ad-a13b-4a89-948c-362e5c6c0b00 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:39.879440 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-dedb0639-c0a1-4e04-9859-4f6d83e8abb3 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=379964a88bd341a29879ed8f68f23e80&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2520826
Jun 01 06:19:39.880181 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 40912) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:39.880880 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dedb0639-c0a1-4e04-9859-4f6d83e8abb3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5aba08f9-b276-4977-8ee1-5478e4844930,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:39.897987 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-dedb0639-c0a1-4e04-9859-4f6d83e8abb3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:39.940589 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-8050996a-0e7d-43a0-956f-503b11ced104 None None] Calling delete_port for 81d48392-f948-43df-923d-bb60ae00642d owned by network:dhcp {{(pid=92231) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:19:39.961574 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-6d07893a-e28a-433c-96b3-ad4ea5dd0a25 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:39.979509 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] Calling delete_port for 81d48392-f948-43df-923d-bb60ae00642d owned by network:dhcp {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:19:39.992144 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-8050996a-0e7d-43a0-956f-503b11ced104 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756'] for port, after_delete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:39.995717 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-6c3e0549-3180-4414-85ea-6c619b0a2dfb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:39.997864 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-6d07893a-e28a-433c-96b3-ad4ea5dd0a25 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:40.044444 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8050996a-0e7d-43a0-956f-503b11ced104 None None] Pushing event deleted for resources: {'Port': ['ID=81d48392-f948-43df-923d-bb60ae00642d,revision_number=None']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:40.051828 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-8050996a-0e7d-43a0-956f-503b11ced104 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:40.055902 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8050996a-0e7d-43a0-956f-503b11ced104 None None] No DVR routers for this DVR port 81d48392-f948-43df-923d-bb60ae00642d on host dv-cinder-793885-1-iscsi {{(pid=92231) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:19:40.061824 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-6d07893a-e28a-433c-96b3-ad4ea5dd0a25 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:40.067143 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-16e39396-d28e-40f1-ab53-fd37d7ae7e11 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:40.078145 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d07893a-e28a-433c-96b3-ad4ea5dd0a25 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5aba08f9-b276-4977-8ee1-5478e4844930,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:40.082709 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-6d07893a-e28a-433c-96b3-ad4ea5dd0a25 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:40.084687 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-6d07893a-e28a-433c-96b3-ad4ea5dd0a25 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:40.089125 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-6d07893a-e28a-433c-96b3-ad4ea5dd0a25 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/5aba08f9-b276-4977-8ee1-5478e4844930 HTTP/1.1" status: 204  len: 168 time: 0.2020884
Jun 01 06:19:40.113025 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e5b8bad-3ece-457b-8691-6331a312d427 req-0207ca86-eeb1-4488-a945-0956fddc20e9 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:40.114484 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1e5b8bad-3ece-457b-8691-6331a312d427 req-0207ca86-eeb1-4488-a945-0956fddc20e9 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 945 time: 0.1298399
Jun 01 06:19:40.115522 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:40.120032 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-e1a22e06-b8c3-4ac1-a09b-9d91d53d62b4 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:40.180326 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] Pushing event deleted for resources: {'Port': ['ID=81d48392-f948-43df-923d-bb60ae00642d,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:40.182158 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] No DVR routers for this DVR port 81d48392-f948-43df-923d-bb60ae00642d on host dv-cinder-793885-1-iscsi {{(pid=92229) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:19:40.186661 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:40.260461 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1e5b8bad-3ece-457b-8691-6331a312d427 req-461e2722-7f17-419b-a9f8-8a292bfc303b tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1123209
Jun 01 06:19:40.289269 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 40918) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:40.291322 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 81d48392-f948-43df-923d-bb60ae00642d no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:19:40.330891 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: 81d48392-f948-43df-923d-bb60ae00642d {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:19:40.331385 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 81d48392-f948-43df-923d-bb60ae00642d not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:19:40.331843 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 2f756d86-5bac-4927-ae20-b147143147c2 no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:19:40.339304 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8093290', 'neutron.services.segments.db._delete_segments_for_network-8788497006300'] for network, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:40.361298 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe3b206a970>,) {'filters': {'network_id': ['a62a4246-c7f6-49f1-8116-df3533b6b298']}} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:19:40.373409 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: 2f756d86-5bac-4927-ae20-b147143147c2 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:19:40.373763 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 2f756d86-5bac-4927-ae20-b147143147c2 not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:19:40.376512 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b206a970>, '7f505287-cd09-4e79-b15f-b1cfa1fb5101') {'for_net_delete': True} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:19:40.376991 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b206a970>, '7f505287-cd09-4e79-b15f-b1cfa1fb5101') {} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:19:40.382235 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-346e565a-8367-4fda-872d-90a5762a3c16 tempest-TestVolumeBootPattern-1044736619 tempest-TestVolumeBootPattern-1044736619-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92230) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:40.384084 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-346e565a-8367-4fda-872d-90a5762a3c16 tempest-TestVolumeBootPattern-1044736619 tempest-TestVolumeBootPattern-1044736619-project-admin] 10.222.0.25 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 1093 time: 0.0911100
Jun 01 06:19:40.387986 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 40924) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:40.390455 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8788497014941', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2127091'] for segment, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:40.393528 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.v2.base [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Request body: {'floatingip': {'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'port_id': '5fa581a1-474d-4dc6-a414-36e7324b8555', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'fixed_ip_address': '172.20.0.3'}} {{(pid=92230) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:19:40.400419 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:19:40.404613 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Usage tracker for resource:floatingip and tenant:e8bcff3fed924886a68a8562a9f4f8f3 is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:19:40.408381 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Quota usage for floatingip was recalculated. Used quota:2. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:19:40.409780 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:40.415563 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attempting to reserve 1 items for resource floatingip. Total usage: 2; quota limit: 50; headroom:48 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:19:40.417939 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] Releasing vlan 205 on physical network physnet1 to pool {{(pid=92229) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 06:19:40.418481 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2077367'] for segment, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:40.427922 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for floatingip, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:   util.warn(
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:   util.warn(
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:   util.warn(
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:   util.warn(
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]: Traceback (most recent call last):
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:     timer()
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:     cb(*args, **kw)
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:     return func(*args, **kwargs)
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:     self._notify()
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:     self.callback(batched_events)
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:     event.method(event)
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:     return f(self, *a, **k)
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self._get(url).json()
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self.request(url, 'GET', **kwargs)
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 06:19:40.432528 dv-cinder-793885-1-iscsi neutron-server[92229]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 06:19:40.510505 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8093283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-745674'] for network, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:40.513845 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 40928) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:40.534227 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:40.552072 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:40.561778 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-2362fbea-bbed-49ed-926e-ab850d372dfa admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:40.576583 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] Pushing event deleted for resources: {'Network': ['ID=a62a4246-c7f6-49f1-8116-df3533b6b298,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:40.586324 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:40.589217 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:40.594802 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-2362fbea-bbed-49ed-926e-ab850d372dfa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:19:40.597779 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] 10.222.0.25 "DELETE /v2.0/networks/a62a4246-c7f6-49f1-8116-df3533b6b298 HTTP/1.1" status: 204  len: 168 time: 1.3452642
Jun 01 06:19:40.600527 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-2362fbea-bbed-49ed-926e-ab850d372dfa admin admin] Usage tracker for resource:security_group_rule and tenant:d57da48d90154bb5b3f07d69b8d7a13b is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:19:40.604113 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-2362fbea-bbed-49ed-926e-ab850d372dfa admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:19:40.610015 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-2362fbea-bbed-49ed-926e-ab850d372dfa admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:19:40.707170 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-2362fbea-bbed-49ed-926e-ab850d372dfa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:40.712105 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-2362fbea-bbed-49ed-926e-ab850d372dfa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:40.720258 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-0b24fdd9-777a-4994-8ea4-88ad4f6103f4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:40.740386 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_common [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Allocated IP 172.27.2.107 (83b812fb-2cfc-46e4-baa4-745218ea3ed2/a59d7d11-a92c-4b4f-83cf-2095ecee2b51/08ccd18d-4e8e-40b0-885e-a163bb4f9e16) {{(pid=92230) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:19:40.763252 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-2362fbea-bbed-49ed-926e-ab850d372dfa admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=d57da48d90154bb5b3f07d69b8d7a13b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2480404
Jun 01 06:19:40.764300 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2362fbea-bbed-49ed-926e-ab850d372dfa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d5201c85-7ef2-4d46-8726-5c789958b841,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:40.766801 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 40934) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:40.769157 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-2362fbea-bbed-49ed-926e-ab850d372dfa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:40.824019 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 40938) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:40.851211 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-82713468-4c49-4f0a-bf89-8a817bc6ceb9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:40.902110 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-82713468-4c49-4f0a-bf89-8a817bc6ceb9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:40.904494 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for port, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:40.918135 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-631a0c1a-1699-4d53-b280-192a3e78819e admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=c0ca2b878b874fe4af6e7b9fa8f6cf59&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0928771
Jun 01 06:19:40.920853 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 40942) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:40.965173 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-82713468-4c49-4f0a-bf89-8a817bc6ceb9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:40.969017 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-e6d688ba-ebb9-413f-8b0f-52a4fd17369c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:40.981120 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82713468-4c49-4f0a-bf89-8a817bc6ceb9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d5201c85-7ef2-4d46-8726-5c789958b841,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:40.988396 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-82713468-4c49-4f0a-bf89-8a817bc6ceb9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:40.997183 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-82713468-4c49-4f0a-bf89-8a817bc6ceb9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:40.997797 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:40.998292 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-82713468-4c49-4f0a-bf89-8a817bc6ceb9 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/d5201c85-7ef2-4d46-8726-5c789958b841 HTTP/1.1" status: 204  len: 168 time: 0.2306919
Jun 01 06:19:41.004836 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-b2b5eedc-f794-4344-98bc-a6fefd090ede admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:41.052674 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-09924399-39d3-4a2b-ba0f-31be1d38b90a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:41.091725 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Network 83b812fb-2cfc-46e4-baa4-745218ea3ed2 is already hosted by enough agents. {{(pid=92230) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:19:41.101592 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.base_scheduler [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Resources bound (agent type, host, resource id):  {{(pid=92230) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:19:41.104506 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Pushing event updated for resources: {'Port': ['ID=08ccd18d-4e8e-40b0-885e-a163bb4f9e16,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:41.106779 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Received port after_create {{(pid=92230) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:19:41.141486 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:41.242226 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:41.254573 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-09924399-39d3-4a2b-ba0f-31be1d38b90a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:41.417363 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-09924399-39d3-4a2b-ba0f-31be1d38b90a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:41.426013 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-fe829816-3028-45bb-8082-ee3332e80b4e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:41.447853 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09924399-39d3-4a2b-ba0f-31be1d38b90a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5985373d-9e4a-40aa-ae6a-494024c07169,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:41.455030 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-09924399-39d3-4a2b-ba0f-31be1d38b90a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:41.532202 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-09924399-39d3-4a2b-ba0f-31be1d38b90a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:41.533225 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-09924399-39d3-4a2b-ba0f-31be1d38b90a admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/5985373d-9e4a-40aa-ae6a-494024c07169 HTTP/1.1" status: 204  len: 168 time: 0.6113684
Jun 01 06:19:41.742117 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:41.826434 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:42.068137 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for port, precommit_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:42.069777 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 40976) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:42.081124 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2416196'] for port, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:42.091329 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-ff5e138d-feb5-41b3-b814-bfeeef725787 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:42.129356 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-b8faa806-0469-48ec-946e-c01872b213de admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=43f56027f58d47f5b11d46a512f3e137&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0579221
Jun 01 06:19:42.131497 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 40980) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:19:42.205599 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-f9a69e4b-db25-4708-97c2-6b8138db0f09 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:42.206136 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-745720'] for floatingip, after_update {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:42.235232 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-f9a69e4b-db25-4708-97c2-6b8138db0f09 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:42.291907 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Pushing event updated for resources: {'Port': ['ID=08ccd18d-4e8e-40b0-885e-a163bb4f9e16,revision_number=2']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:42.295729 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.204s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:42.302156 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-f9a69e4b-db25-4708-97c2-6b8138db0f09 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:42.306704 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-8b1761ab-091d-4694-a5c5-af1c4c1ed265 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:19:42.319222 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9a69e4b-db25-4708-97c2-6b8138db0f09 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=928b09ab-dc11-4d86-ab5b-b0f3261d42a0,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:19:42.322146 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-f9a69e4b-db25-4708-97c2-6b8138db0f09 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:19:42.347374 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-f9a69e4b-db25-4708-97c2-6b8138db0f09 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:42.351333 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-f9a69e4b-db25-4708-97c2-6b8138db0f09 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/928b09ab-dc11-4d86-ab5b-b0f3261d42a0 HTTP/1.1" status: 204  len: 168 time: 0.2166693
Jun 01 06:19:42.360013 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-f3f91726-0498-44af-bd7d-9b7c30fbf8f3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:42.448662 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.db.l3_db [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Floating IP 38fc97e4-d1c2-4c92-a32d-6962e82b5c2d associated. External IP: 172.27.2.107, port: 5fa581a1-474d-4dc6-a414-36e7324b8555.
Jun 01 06:19:42.880007 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Router 00ab7a71-e7f7-4524-99c9-7562f23905d1 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92230) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:19:43.181570 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:19:43.192895 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4cd43038-76e6-4310-a8e1-435f54503cc5 None None] Sync routers for ids ['00ab7a71-e7f7-4524-99c9-7562f23905d1'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:19:43.204252 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4cd43038-76e6-4310-a8e1-435f54503cc5 None None] Routers {'00ab7a71-e7f7-4524-99c9-7562f23905d1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:19:43.205023 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-4cd43038-76e6-4310-a8e1-435f54503cc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b249ea00>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:19:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['00ab7a71-e7f7-4524-99c9-7562f23905d1'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:19:43.206592 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for floatingip, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:43.284717 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-25282a60-ba02-4be8-b67c-168878a96a9c tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 2.8807147
Jun 01 06:19:43.284717 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'af5f753c-f6ea-450a-ac47-3802c6b16eb3', 'tag': '5fa581a1-474d-4dc6-a414-36e7324b8555'}] {{(pid=92230) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:19:43.284717 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a8971187fdc179bafebfda031591b22633150c3ea1d9449252a7819502f19756" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ad92d11c-0465-4cf1-b437-b7336a92e03a" -d '{"events": [{"name": "network-changed", "server_uuid": "af5f753c-f6ea-450a-ac47-3802c6b16eb3", "tag": "5fa581a1-474d-4dc6-a414-36e7324b8555"}]}' {{(pid=92230) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:19:43.300124 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:43.319368 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:19:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2d6702ad-4a49-4509-a32c-ac5a315186c1 x-openstack-request-id: req-2d6702ad-4a49-4509-a32c-ac5a315186c1 {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:19:43.319704 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "af5f753c-f6ea-450a-ac47-3802c6b16eb3", "tag": "5fa581a1-474d-4dc6-a414-36e7324b8555", "status": "completed", "code": 200}]} {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:19:43.320032 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-2d6702ad-4a49-4509-a32c-ac5a315186c1 {{(pid=92230) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:19:43.320468 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'af5f753c-f6ea-450a-ac47-3802c6b16eb3', 'tag': '5fa581a1-474d-4dc6-a414-36e7324b8555', 'status': 'completed', 'code': 200}
Jun 01 06:19:43.429035 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad92d11c-0465-4cf1-b437-b7336a92e03a req-3086f3b4-e00e-4331-b16a-aa5f231d732d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:43.429992 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-4cd43038-76e6-4310-a8e1-435f54503cc5 None None] Set router 00ab7a71-e7f7-4524-99c9-7562f23905d1 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:19:43.431126 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ad92d11c-0465-4cf1-b437-b7336a92e03a req-3086f3b4-e00e-4331-b16a-aa5f231d732d service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=e8bcff3fed924886a68a8562a9f4f8f3&device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 1098 time: 0.0862780
Jun 01 06:19:43.584110 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad92d11c-0465-4cf1-b437-b7336a92e03a req-f8fd8bcc-43af-4e97-b93b-508fa0471605 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:43.585711 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ad92d11c-0465-4cf1-b437-b7336a92e03a req-f8fd8bcc-43af-4e97-b93b-508fa0471605 service neutron] 10.222.0.48 "GET /v2.0/networks?id=028fef0a-f05a-48d5-ba5c-b539846209ba HTTP/1.1" status: 200  len: 912 time: 0.1482217
Jun 01 06:19:43.712458 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ad92d11c-0465-4cf1-b437-b7336a92e03a req-317f85d4-a2ed-4174-bd07-ed84c381fc41 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=5fa581a1-474d-4dc6-a414-36e7324b8555 HTTP/1.1" status: 200  len: 999 time: 0.1152978
Jun 01 06:19:43.782404 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad92d11c-0465-4cf1-b437-b7336a92e03a req-06922be8-f2c0-4f15-a21d-f868109ca64f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:43.783931 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ad92d11c-0465-4cf1-b437-b7336a92e03a req-06922be8-f2c0-4f15-a21d-f868109ca64f service neutron] 10.222.0.48 "GET /v2.0/subnets?id=cdffe000-7f35-495d-a741-b4c48a060887 HTTP/1.1" status: 200  len: 850 time: 0.0654986
Jun 01 06:19:43.823245 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-4cd43038-76e6-4310-a8e1-435f54503cc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b249ea00>, [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '38fc97e4-d1c2-4c92-a32d-6962e82b5c2d', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'floating_ip_address': '172.27.2.107', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'port_id': '5fa581a1-474d-4dc6-a414-36e7324b8555', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 661, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'mac_address': 'fa:16:3e:ee:45:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af5f753c-f6ea-450a-ac47-3802c6b16eb3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:19:41Z', 'updated_at': '2021-06-01T06:19:41Z', 'revision_number': 0, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'fixed_ip_address_scope': None}, {'id': '4292dbbd-2970-492d-a5df-e73465d512a2', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'floating_ip_address': '172.27.2.125', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'port_id': '5ba208bf-2519-4a15-b4f5-8246cedadc63', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 582, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'mac_address': 'fa:16:3e:bd:39:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3152e52-efff-440c-a60c-0c4b931f7132', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:17:34Z', 'updated_at': '2021-06-01T06:17:39Z', 'revision_number': 1, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cd6dda6e-46d3-4412-9652-c686f5fad712', 'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'mac_address': 'fa:16:3e:aa:f2:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:24Z', 'updated_at': '2021-06-01T06:13:41Z', 'revision_number': 5, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'subnets': [{'id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:19:43.827772 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4cd43038-76e6-4310-a8e1-435f54503cc5 None None] Checking router: 00ab7a71-e7f7-4524-99c9-7562f23905d1 for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:19:43.839306 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4cd43038-76e6-4310-a8e1-435f54503cc5 None None] Routers {'00ab7a71-e7f7-4524-99c9-7562f23905d1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:19:43.839994 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-4cd43038-76e6-4310-a8e1-435f54503cc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b249ea00>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:19:42Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['00ab7a71-e7f7-4524-99c9-7562f23905d1'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:19:43.870875 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad92d11c-0465-4cf1-b437-b7336a92e03a req-344a2328-c2bc-4139-a91b-a8908af00466 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:43.872373 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ad92d11c-0465-4cf1-b437-b7336a92e03a req-344a2328-c2bc-4139-a91b-a8908af00466 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=028fef0a-f05a-48d5-ba5c-b539846209ba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0812416
Jun 01 06:19:44.051676 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-4cd43038-76e6-4310-a8e1-435f54503cc5 None None] Set router 00ab7a71-e7f7-4524-99c9-7562f23905d1 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:19:44.163143 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ad92d11c-0465-4cf1-b437-b7336a92e03a req-85391be7-a8ea-40b4-9f76-0cd07848b398 service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2812564
Jun 01 06:19:44.379926 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ad92d11c-0465-4cf1-b437-b7336a92e03a req-46ebe35c-716e-470f-a183-604cd126d02c service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2092419
Jun 01 06:19:44.517839 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-4cd43038-76e6-4310-a8e1-435f54503cc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b249ea00>, [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '38fc97e4-d1c2-4c92-a32d-6962e82b5c2d', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'floating_ip_address': '172.27.2.107', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'port_id': '5fa581a1-474d-4dc6-a414-36e7324b8555', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 661, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'mac_address': 'fa:16:3e:ee:45:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af5f753c-f6ea-450a-ac47-3802c6b16eb3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:19:41Z', 'updated_at': '2021-06-01T06:19:41Z', 'revision_number': 0, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'fixed_ip_address_scope': None}, {'id': '4292dbbd-2970-492d-a5df-e73465d512a2', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'floating_ip_address': '172.27.2.125', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'port_id': '5ba208bf-2519-4a15-b4f5-8246cedadc63', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 582, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'mac_address': 'fa:16:3e:bd:39:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3152e52-efff-440c-a60c-0c4b931f7132', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:17:34Z', 'updated_at': '2021-06-01T06:17:39Z', 'revision_number': 1, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cd6dda6e-46d3-4412-9652-c686f5fad712', 'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'mac_address': 'fa:16:3e:aa:f2:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:24Z', 'updated_at': '2021-06-01T06:13:41Z', 'revision_number': 5, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'subnets': [{'id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:19:44.522540 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4cd43038-76e6-4310-a8e1-435f54503cc5 None None] The sync data for ids ['00ab7a71-e7f7-4524-99c9-7562f23905d1'] in dv-cinder-793885-1-iscsi is: [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '38fc97e4-d1c2-4c92-a32d-6962e82b5c2d', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'floating_ip_address': '172.27.2.107', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'port_id': '5fa581a1-474d-4dc6-a414-36e7324b8555', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 661, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'mac_address': 'fa:16:3e:ee:45:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af5f753c-f6ea-450a-ac47-3802c6b16eb3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:19:41Z', 'updated_at': '2021-06-01T06:19:41Z', 'revision_number': 0, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'fixed_ip_address_scope': None}, {'id': '4292dbbd-2970-492d-a5df-e73465d512a2', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'floating_ip_address': '172.27.2.125', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'port_id': '5ba208bf-2519-4a15-b4f5-8246cedadc63', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 582, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'mac_address': 'fa:16:3e:bd:39:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3152e52-efff-440c-a60c-0c4b931f7132', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:17:34Z', 'updated_at': '2021-06-01T06:17:39Z', 'revision_number': 1, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cd6dda6e-46d3-4412-9652-c686f5fad712', 'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'mac_address': 'fa:16:3e:aa:f2:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:24Z', 'updated_at': '2021-06-01T06:13:41Z', 'revision_number': 5, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'subnets': [{'id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:19:44.737773 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9294439c-9ac6-45a6-a63d-449cf8585552 None None] New status for floating IP 38fc97e4-d1c2-4c92-a32d-6962e82b5c2d: ACTIVE {{(pid=92232) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 06:19:45.383180 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:46.021077 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:19:47.707498 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-55bcfebe-af29-48d2-8ce5-b20eb37d0a47 req-174a1161-ac28-448b-9f6e-fe88b4577f57 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=c3152e52-efff-440c-a60c-0c4b931f7132&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0732338
Jun 01 06:19:47.872389 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55bcfebe-af29-48d2-8ce5-b20eb37d0a47 req-8786cdca-8abd-486b-ba2a-98d749fce470 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:47.873859 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-55bcfebe-af29-48d2-8ce5-b20eb37d0a47 req-8786cdca-8abd-486b-ba2a-98d749fce470 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=e8bcff3fed924886a68a8562a9f4f8f3&device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 1098 time: 0.0809443
Jun 01 06:19:48.036131 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55bcfebe-af29-48d2-8ce5-b20eb37d0a47 req-2288736a-6045-4ceb-9d17-6fa4700f2082 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:48.037578 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-55bcfebe-af29-48d2-8ce5-b20eb37d0a47 req-2288736a-6045-4ceb-9d17-6fa4700f2082 service neutron] 10.222.0.48 "GET /v2.0/networks?id=028fef0a-f05a-48d5-ba5c-b539846209ba HTTP/1.1" status: 200  len: 912 time: 0.1379671
Jun 01 06:19:48.146839 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-55bcfebe-af29-48d2-8ce5-b20eb37d0a47 req-2b30db21-bcd7-4ca4-8d5e-758fabe0dc8b service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=5ba208bf-2519-4a15-b4f5-8246cedadc63 HTTP/1.1" status: 200  len: 1001 time: 0.0979972
Jun 01 06:19:48.218511 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55bcfebe-af29-48d2-8ce5-b20eb37d0a47 req-e044923d-92dc-411f-9164-6839d5eee3b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:48.219994 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-55bcfebe-af29-48d2-8ce5-b20eb37d0a47 req-e044923d-92dc-411f-9164-6839d5eee3b1 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=cdffe000-7f35-495d-a741-b4c48a060887 HTTP/1.1" status: 200  len: 850 time: 0.0663619
Jun 01 06:19:48.302178 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55bcfebe-af29-48d2-8ce5-b20eb37d0a47 req-ffb22fa7-71be-4a37-b387-882b6cef87de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:19:48.303667 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-55bcfebe-af29-48d2-8ce5-b20eb37d0a47 req-ffb22fa7-71be-4a37-b387-882b6cef87de service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=028fef0a-f05a-48d5-ba5c-b539846209ba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0764818
Jun 01 06:19:48.452747 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-55bcfebe-af29-48d2-8ce5-b20eb37d0a47 req-fabdb2f7-89e2-44bf-b798-dc90ee5c3728 service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1370018
Jun 01 06:19:48.593049 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-55bcfebe-af29-48d2-8ce5-b20eb37d0a47 req-95b26311-d432-42d5-b2f2-66ef68ca533c service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1338220
Jun 01 06:20:07.724885 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:20:08.333522 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-3228c3d6-0f9a-4b30-b984-2382bd5b48a3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:11.236114 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:12.345177 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4a66cce2-5948-4ad3-8a1b-ea94156d604d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:13.289050 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:15.386012 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:16.030561 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:17.383008 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 41162) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:20:17.502149 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4eb72ad3-cf17-482d-95c2-8bb051e0bbbf admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:17.516791 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-4eb72ad3-cf17-482d-95c2-8bb051e0bbbf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:20:17.520564 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-4eb72ad3-cf17-482d-95c2-8bb051e0bbbf admin admin] Usage tracker for resource:security_group_rule and tenant:ee627f61861b4d459a02b70bad9e5d58 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:20:17.523329 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-4eb72ad3-cf17-482d-95c2-8bb051e0bbbf admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:20:17.529883 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-4eb72ad3-cf17-482d-95c2-8bb051e0bbbf admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:20:17.620478 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4eb72ad3-cf17-482d-95c2-8bb051e0bbbf admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:17.624129 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-4eb72ad3-cf17-482d-95c2-8bb051e0bbbf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:17.631426 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-d02d5600-c9b9-4f6d-818f-18f47ee085ab admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:20:17.674901 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-4eb72ad3-cf17-482d-95c2-8bb051e0bbbf admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=ee627f61861b4d459a02b70bad9e5d58&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2907941
Jun 01 06:20:17.675963 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eb72ad3-cf17-482d-95c2-8bb051e0bbbf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d1fdd2a6-ce4a-4334-8ff9-b8d79fdbce7b,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:20:17.677571 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 41168) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:20:17.679169 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-4eb72ad3-cf17-482d-95c2-8bb051e0bbbf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:20:17.752665 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3a8f4d68-9da3-4c83-b49e-cff93ef6601a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:17.780207 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3a8f4d68-9da3-4c83-b49e-cff93ef6601a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:17.834803 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3a8f4d68-9da3-4c83-b49e-cff93ef6601a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:17.839530 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-82262982-3847-4cb4-a226-90c5762439e6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:20:17.850900 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a8f4d68-9da3-4c83-b49e-cff93ef6601a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d1fdd2a6-ce4a-4334-8ff9-b8d79fdbce7b,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:20:17.861745 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-3a8f4d68-9da3-4c83-b49e-cff93ef6601a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:17.862849 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-3a8f4d68-9da3-4c83-b49e-cff93ef6601a admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/d1fdd2a6-ce4a-4334-8ff9-b8d79fdbce7b HTTP/1.1" status: 204  len: 168 time: 0.1835713
Jun 01 06:20:17.864289 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a8f4d68-9da3-4c83-b49e-cff93ef6601a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:17.864668 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a8f4d68-9da3-4c83-b49e-cff93ef6601a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:17.865040 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a8f4d68-9da3-4c83-b49e-cff93ef6601a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:17.865434 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a8f4d68-9da3-4c83-b49e-cff93ef6601a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:17.865804 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a8f4d68-9da3-4c83-b49e-cff93ef6601a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:17.866162 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a8f4d68-9da3-4c83-b49e-cff93ef6601a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:17.866521 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a8f4d68-9da3-4c83-b49e-cff93ef6601a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:17.866948 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a8f4d68-9da3-4c83-b49e-cff93ef6601a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:17.867224 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a8f4d68-9da3-4c83-b49e-cff93ef6601a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:17.867983 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a8f4d68-9da3-4c83-b49e-cff93ef6601a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:17.868484 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a8f4d68-9da3-4c83-b49e-cff93ef6601a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:17.868855 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a8f4d68-9da3-4c83-b49e-cff93ef6601a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:17.872168 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-3a8f4d68-9da3-4c83-b49e-cff93ef6601a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:20:30.044940 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 41312) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:20:30.164672 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-74b8439a-9fd4-498f-896b-cbf8af78adc2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:30.179355 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-74b8439a-9fd4-498f-896b-cbf8af78adc2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:20:30.183668 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-74b8439a-9fd4-498f-896b-cbf8af78adc2 admin admin] Usage tracker for resource:security_group_rule and tenant:881a33c891d149da880741b2c442683a is out of sync, need to count used quota {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:20:30.186921 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.quota.resource [None req-74b8439a-9fd4-498f-896b-cbf8af78adc2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92230) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:20:30.192698 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.quota.driver [None req-74b8439a-9fd4-498f-896b-cbf8af78adc2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92230) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:20:30.282465 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-74b8439a-9fd4-498f-896b-cbf8af78adc2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:30.286247 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-74b8439a-9fd4-498f-896b-cbf8af78adc2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:30.294915 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-6d07893a-e28a-433c-96b3-ad4ea5dd0a25 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:20:30.342585 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-74b8439a-9fd4-498f-896b-cbf8af78adc2 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=881a33c891d149da880741b2c442683a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2965505
Jun 01 06:20:30.343388 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74b8439a-9fd4-498f-896b-cbf8af78adc2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=97d26516-9e7f-4048-98ce-e14256cd3764,revision_number=1']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:20:30.345393 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 41318) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:20:30.346569 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-74b8439a-9fd4-498f-896b-cbf8af78adc2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:20:30.406679 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-f48cab90-a81c-4498-ae86-d58f8a6e1802 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:30.432321 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-f48cab90-a81c-4498-ae86-d58f8a6e1802 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:30.486098 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-f48cab90-a81c-4498-ae86-d58f8a6e1802 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:30.490993 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-db1d2165-8be6-439d-ae29-eadcb74b120c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:20:30.507344 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f48cab90-a81c-4498-ae86-d58f8a6e1802 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=97d26516-9e7f-4048-98ce-e14256cd3764,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:20:30.511987 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-f48cab90-a81c-4498-ae86-d58f8a6e1802 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:20:30.518160 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-f48cab90-a81c-4498-ae86-d58f8a6e1802 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:30.519293 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-f48cab90-a81c-4498-ae86-d58f8a6e1802 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/97d26516-9e7f-4048-98ce-e14256cd3764 HTTP/1.1" status: 204  len: 168 time: 0.1727636
Jun 01 06:20:33.038087 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f93ff037-905b-4902-b574-66f2ab35c709 req-5a4d6dab-c057-402f-a12f-701ba2a2e3d5 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.25 "GET /v2.0/networks?tenant_id=eab2be7258544f5194b374fd04d4a3f4&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0300572
Jun 01 06:20:33.193848 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f93ff037-905b-4902-b574-66f2ab35c709 req-4f3ec5ac-4b78-4b2b-b8f0-daa1952f2e11 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:33.195200 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f93ff037-905b-4902-b574-66f2ab35c709 req-4f3ec5ac-4b78-4b2b-b8f0-daa1952f2e11 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.1516440
Jun 01 06:20:33.210355 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f93ff037-905b-4902-b574-66f2ab35c709 req-06329b19-95b6-45bb-8677-1f448b11be18 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.25 "GET /v2.0/quotas/eab2be7258544f5194b374fd04d4a3f4 HTTP/1.1" status: 200  len: 375 time: 0.0090704
Jun 01 06:20:33.258340 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f93ff037-905b-4902-b574-66f2ab35c709 req-cfb89f99-f5c0-4449-8e80-47e685c1dac6 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=eab2be7258544f5194b374fd04d4a3f4&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0421364
Jun 01 06:20:33.444425 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e49cf9ef-2a2b-471e-8660-5b55ebb20977 req-d4d406e5-3897-4669-9b23-e69f3359722c tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.25 "GET /v2.0/ports?device_id=860a551e-b4d2-4e7a-91b7-202cdb9209e8 HTTP/1.1" status: 200  len: 210 time: 0.0440574
Jun 01 06:20:34.617773 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d62b84db-5a70-4a6d-9aa8-842fd9df86cf req-1997a318-9576-48f7-808f-4d96aebd8ff1 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.25 "GET /v2.0/ports?device_id=860a551e-b4d2-4e7a-91b7-202cdb9209e8 HTTP/1.1" status: 200  len: 210 time: 0.0563889
Jun 01 06:20:34.655164 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f93ff037-905b-4902-b574-66f2ab35c709 req-f99b45df-0acb-4355-b02b-ddf99e4a9709 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.48 "GET /v2.0/networks?tenant_id=eab2be7258544f5194b374fd04d4a3f4&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0319884
Jun 01 06:20:34.917559 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f93ff037-905b-4902-b574-66f2ab35c709 req-d64e57b8-4728-4edb-bb5f-93537c053dbc tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:34.919002 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f93ff037-905b-4902-b574-66f2ab35c709 req-d64e57b8-4728-4edb-bb5f-93537c053dbc tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.48 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.2591853
Jun 01 06:20:34.936932 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Request body: {'port': {'device_id': '860a551e-b4d2-4e7a-91b7-202cdb9209e8', 'network_id': 'a6d7f63e-e70d-44f5-881d-b8b75ee09c7f', 'admin_state_up': True, 'tenant_id': 'eab2be7258544f5194b374fd04d4a3f4'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:20:35.077868 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:20:35.081684 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Usage tracker for resource:port and tenant:eab2be7258544f5194b374fd04d4a3f4 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:20:35.084516 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:20:35.090281 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:20:35.099948 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Made reservation on behalf of eab2be7258544f5194b374fd04d4a3f4 for: {'port': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:20:35.103310 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:35.118498 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:35.134011 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:20:35.138446 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Usage tracker for resource:security_group_rule and tenant:eab2be7258544f5194b374fd04d4a3f4 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:20:35.141255 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:20:35.146937 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:20:35.231685 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:35.235343 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:35.238165 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-f48cab90-a81c-4498-ae86-d58f8a6e1802 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:20:35.321735 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Pushing event updated for resources: {'SecurityGroup': ['ID=978c78c3-4dc2-4d56-8556-630ff2a85083,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:20:35.329990 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:20:35.412580 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Allocated IP 192.168.233.157 (a6d7f63e-e70d-44f5-881d-b8b75ee09c7f/207ba625-cb20-4380-b8f8-452b3a0a4864/30106fe0-df57-4888-b1b7-0efd1cef3638) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:20:35.626895 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:35.643201 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Transition to ACTIVE for port object 30106fe0-df57-4888-b1b7-0efd1cef3638 will not be triggered until provisioned by entity DHCP. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:20:35.670191 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:35.678347 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b796b785-ed64-47b9-98bf-928c0385bd8a tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:20:35.740920 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Network a6d7f63e-e70d-44f5-881d-b8b75ee09c7f is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:20:35.744429 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:20:35.748681 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:20:35.852178 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Pushing event updated for resources: {'Port': ['ID=30106fe0-df57-4888-b1b7-0efd1cef3638,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:20:35.859520 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:20:35.886881 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:35.887549 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:35.925085 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f93ff037-905b-4902-b574-66f2ab35c709 req-bd76de35-9e63-4d4b-9ff8-e7dedab05ab3 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201  len: 938 time: 0.9923375
Jun 01 06:20:35.934906 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ccdb0f9-ab0b-4d73-9136-43ca9b0bc7bb req-d716586f-3ed2-47a9-956e-d42a48467062 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:35.935645 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-5ccdb0f9-ab0b-4d73-9136-43ca9b0bc7bb req-d716586f-3ed2-47a9-956e-d42a48467062 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Synchronizing usage tracker for tenant:eab2be7258544f5194b374fd04d4a3f4 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:20:35.941629 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-b006898a-9843-447c-8ebc-773742352073 None None] Provisioning for port 30106fe0-df57-4888-b1b7-0efd1cef3638 completed by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:20:35.945276 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-f93ff037-905b-4902-b574-66f2ab35c709 req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Request body: {'port': {'device_id': '860a551e-b4d2-4e7a-91b7-202cdb9209e8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79388'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:20:35.947370 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-b006898a-9843-447c-8ebc-773742352073 None None] Provisioning complete for port 30106fe0-df57-4888-b1b7-0efd1cef3638 triggered by entity DHCP. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:20:35.947740 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b006898a-9843-447c-8ebc-773742352073 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:36.012710 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-b006898a-9843-447c-8ebc-773742352073 None None] Port 30106fe0-df57-4888-b1b7-0efd1cef3638 cannot update to ACTIVE because it is not bound. {{(pid=92231) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 06:20:36.016342 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-5ccdb0f9-ab0b-4d73-9136-43ca9b0bc7bb req-d716586f-3ed2-47a9-956e-d42a48467062 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Unset dirty status for tenant:eab2be7258544f5194b374fd04d4a3f4 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:20:36.017650 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5ccdb0f9-ab0b-4d73-9136-43ca9b0bc7bb req-d716586f-3ed2-47a9-956e-d42a48467062 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.25 "GET /v2.0/ports?device_id=860a551e-b4d2-4e7a-91b7-202cdb9209e8 HTTP/1.1" status: 200  len: 936 time: 0.2371926
Jun 01 06:20:36.114191 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-f93ff037-905b-4902-b574-66f2ab35c709 req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:36.124880 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-5ccdb0f9-ab0b-4d73-9136-43ca9b0bc7bb req-87de9e47-2686-4da2-a85c-54bb590414ea tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Synchronizing usage tracker for tenant:eab2be7258544f5194b374fd04d4a3f4 on resource:security_group {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:20:36.191822 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-5ccdb0f9-ab0b-4d73-9136-43ca9b0bc7bb req-87de9e47-2686-4da2-a85c-54bb590414ea tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Unset dirty status for tenant:eab2be7258544f5194b374fd04d4a3f4 on resource:security_group {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:20:36.192870 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5ccdb0f9-ab0b-4d73-9136-43ca9b0bc7bb req-87de9e47-2686-4da2-a85c-54bb590414ea tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.25 "GET /v2.0/security-groups?id=978c78c3-4dc2-4d56-8556-630ff2a85083&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1685708
Jun 01 06:20:36.543197 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [req-f93ff037-905b-4902-b574-66f2ab35c709 req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 30106fe0-df57-4888-b1b7-0efd1cef3638 {{(pid=92229) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:20:36.550706 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-f93ff037-905b-4902-b574-66f2ab35c709 req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:36.566879 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-f93ff037-905b-4902-b574-66f2ab35c709 req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Transition to ACTIVE for port object 30106fe0-df57-4888-b1b7-0efd1cef3638 will not be triggered until provisioned by entity L2. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:20:36.572883 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-f93ff037-905b-4902-b574-66f2ab35c709 req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2077419'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:36.577644 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-99e95455-665c-4b57-b782-498d79d43bb1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:20:36.731188 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Pushing event updated for resources: {'Port': ['ID=30106fe0-df57-4888-b1b7-0efd1cef3638,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:20:36.738544 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:20:36.822848 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-f93ff037-905b-4902-b574-66f2ab35c709 req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Attempting to bind port 30106fe0-df57-4888-b1b7-0efd1cef3638 on host hv-cinder-79388 for vnic_type normal with profile  {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:20:36.823326 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-f93ff037-905b-4902-b574-66f2ab35c709 req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Attempting to bind port 30106fe0-df57-4888-b1b7-0efd1cef3638 by drivers openvswitch,hyperv on host hv-cinder-79388 at level 0 using segments [{'id': '2163afda-8422-40f1-8678-56aeadbe45b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 235, 'network_id': 'a6d7f63e-e70d-44f5-881d-b8b75ee09c7f'}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:20:36.823761 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f93ff037-905b-4902-b574-66f2ab35c709 req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Attempting to bind port 30106fe0-df57-4888-b1b7-0efd1cef3638 on network a6d7f63e-e70d-44f5-881d-b8b75ee09c7f {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:20:36.830084 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f93ff037-905b-4902-b574-66f2ab35c709 req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Port 30106fe0-df57-4888-b1b7-0efd1cef3638 on network a6d7f63e-e70d-44f5-881d-b8b75ee09c7f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79388 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 06:20:36.830488 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f93ff037-905b-4902-b574-66f2ab35c709 req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Attempting to bind port 30106fe0-df57-4888-b1b7-0efd1cef3638 on network a6d7f63e-e70d-44f5-881d-b8b75ee09c7f {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:20:36.836404 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f93ff037-905b-4902-b574-66f2ab35c709 req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Checking agent: {'id': '56148394-2131-4d06-bcfa-c032301591b8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79388', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'started_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 20, 16), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:20:36.836731 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f93ff037-905b-4902-b574-66f2ab35c709 req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Checking segment: {'id': '2163afda-8422-40f1-8678-56aeadbe45b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 235, 'network_id': 'a6d7f63e-e70d-44f5-881d-b8b75ee09c7f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:20:36.837116 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f93ff037-905b-4902-b574-66f2ab35c709 req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Bound using segment: {'id': '2163afda-8422-40f1-8678-56aeadbe45b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 235, 'network_id': 'a6d7f63e-e70d-44f5-881d-b8b75ee09c7f'} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:20:36.837545 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-f93ff037-905b-4902-b574-66f2ab35c709 req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Bound port: 30106fe0-df57-4888-b1b7-0efd1cef3638, host: hv-cinder-79388, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2163afda-8422-40f1-8678-56aeadbe45b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 235, 'network_id': 'a6d7f63e-e70d-44f5-881d-b8b75ee09c7f'}}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:20:36.837889 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-f93ff037-905b-4902-b574-66f2ab35c709 req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:37.033187 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-f93ff037-905b-4902-b574-66f2ab35c709 req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] For port 30106fe0-df57-4888-b1b7-0efd1cef3638, host hv-cinder-79388, cleared binding levels {{(pid=92229) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:20:37.036511 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-f93ff037-905b-4902-b574-66f2ab35c709 req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] For port 30106fe0-df57-4888-b1b7-0efd1cef3638, host hv-cinder-79388, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=30106fe0-df57-4888-b1b7-0efd1cef3638,segment=NetworkSegment(2163afda-8422-40f1-8678-56aeadbe45b7),segment_id=2163afda-8422-40f1-8678-56aeadbe45b7)] {{(pid=92229) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:20:37.041360 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-f93ff037-905b-4902-b574-66f2ab35c709 req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2077419'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:37.046620 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-84961748-8d8b-42e6-bc3d-a66be0f04455 tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:20:37.110192 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f93ff037-905b-4902-b574-66f2ab35c709 req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:37.110810 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-f93ff037-905b-4902-b574-66f2ab35c709 req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:37.112204 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f93ff037-905b-4902-b574-66f2ab35c709 req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] 10.222.0.48 "PUT /v2.0/ports/30106fe0-df57-4888-b1b7-0efd1cef3638 HTTP/1.1" status: 200  len: 1098 time: 1.1719694
Jun 01 06:20:37.112747 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '860a551e-b4d2-4e7a-91b7-202cdb9209e8', 'tag': '30106fe0-df57-4888-b1b7-0efd1cef3638'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:20:37.115025 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d4f1e01e-f649-4310-ad4d-9aab2cd8cd63" -d '{"events": [{"name": "network-changed", "server_uuid": "860a551e-b4d2-4e7a-91b7-202cdb9209e8", "tag": "30106fe0-df57-4888-b1b7-0efd1cef3638"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:20:37.136973 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Pushing event updated for resources: {'Port': ['ID=30106fe0-df57-4888-b1b7-0efd1cef3638,revision_number=3']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:20:37.139766 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:20:37.168650 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:20:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d584cb8b-d1f6-415b-968e-45039c28d4f4 x-openstack-request-id: req-d584cb8b-d1f6-415b-968e-45039c28d4f4 {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:20:37.168979 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "860a551e-b4d2-4e7a-91b7-202cdb9209e8", "tag": "30106fe0-df57-4888-b1b7-0efd1cef3638", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:20:37.169306 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-d584cb8b-d1f6-415b-968e-45039c28d4f4 {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:20:37.169749 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '860a551e-b4d2-4e7a-91b7-202cdb9209e8', 'tag': '30106fe0-df57-4888-b1b7-0efd1cef3638', 'status': 'completed', 'code': 200}
Jun 01 06:20:37.255147 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f93ff037-905b-4902-b574-66f2ab35c709 req-69c795bf-7cf7-4138-8cf7-6bd68ad96cb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:37.256689 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f93ff037-905b-4902-b574-66f2ab35c709 req-69c795bf-7cf7-4138-8cf7-6bd68ad96cb4 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=eab2be7258544f5194b374fd04d4a3f4&device_id=860a551e-b4d2-4e7a-91b7-202cdb9209e8 HTTP/1.1" status: 200  len: 1101 time: 0.0799968
Jun 01 06:20:37.373869 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f93ff037-905b-4902-b574-66f2ab35c709 req-e7147b66-ebcf-4913-9a63-326be7cb01f4 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.157&port_id=30106fe0-df57-4888-b1b7-0efd1cef3638 HTTP/1.1" status: 200  len: 217 time: 0.1100552
Jun 01 06:20:37.460340 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f93ff037-905b-4902-b574-66f2ab35c709 req-b6d51dcf-12b6-44f0-ade8-cff73494498f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:37.461778 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f93ff037-905b-4902-b574-66f2ab35c709 req-b6d51dcf-12b6-44f0-ade8-cff73494498f service neutron] 10.222.0.48 "GET /v2.0/subnets?id=207ba625-cb20-4380-b8f8-452b3a0a4864 HTTP/1.1" status: 200  len: 843 time: 0.0778549
Jun 01 06:20:37.508405 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3102523a-6678-4400-b41c-c830eee2bdc3 req-9c60db61-c17e-4b21-9af9-df6ea397cc54 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:37.509858 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3102523a-6678-4400-b41c-c830eee2bdc3 req-9c60db61-c17e-4b21-9af9-df6ea397cc54 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.25 "GET /v2.0/ports?device_id=860a551e-b4d2-4e7a-91b7-202cdb9209e8 HTTP/1.1" status: 200  len: 948 time: 0.1947615
Jun 01 06:20:37.580427 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3102523a-6678-4400-b41c-c830eee2bdc3 req-f53a076d-f534-4c21-b57f-525ebcb9eec9 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.25 "GET /v2.0/security-groups?id=978c78c3-4dc2-4d56-8556-630ff2a85083&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0637860
Jun 01 06:20:37.594630 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f93ff037-905b-4902-b574-66f2ab35c709 req-580c7615-4764-4d53-bf34-47a51711d676 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:37.596123 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f93ff037-905b-4902-b574-66f2ab35c709 req-580c7615-4764-4d53-bf34-47a51711d676 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=a6d7f63e-e70d-44f5-881d-b8b75ee09c7f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1178 time: 0.1268549
Jun 01 06:20:37.730318 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f93ff037-905b-4902-b574-66f2ab35c709 req-0e0bec9b-3d0b-4109-86c3-74b1f747257e service neutron] 10.222.0.48 "GET /v2.0/networks/a6d7f63e-e70d-44f5-881d-b8b75ee09c7f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1275561
Jun 01 06:20:37.862211 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f93ff037-905b-4902-b574-66f2ab35c709 req-2aee044a-a9aa-43b6-92db-7ef27b42b24d service neutron] 10.222.0.48 "GET /v2.0/networks/a6d7f63e-e70d-44f5-881d-b8b75ee09c7f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1255264
Jun 01 06:20:37.985619 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4f1e01e-f649-4310-ad4d-9aab2cd8cd63 req-9bd89076-6f65-461b-8b4e-d75221998930 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:37.987086 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d4f1e01e-f649-4310-ad4d-9aab2cd8cd63 req-9bd89076-6f65-461b-8b4e-d75221998930 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=eab2be7258544f5194b374fd04d4a3f4&device_id=860a551e-b4d2-4e7a-91b7-202cdb9209e8 HTTP/1.1" status: 200  len: 1101 time: 0.0772700
Jun 01 06:20:38.117900 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4f1e01e-f649-4310-ad4d-9aab2cd8cd63 req-6f8d54ad-7516-44ee-aee5-a2413a072b0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:38.119220 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d4f1e01e-f649-4310-ad4d-9aab2cd8cd63 req-6f8d54ad-7516-44ee-aee5-a2413a072b0c service neutron] 10.222.0.48 "GET /v2.0/networks?id=a6d7f63e-e70d-44f5-881d-b8b75ee09c7f HTTP/1.1" status: 200  len: 870 time: 0.1254611
Jun 01 06:20:38.186480 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d4f1e01e-f649-4310-ad4d-9aab2cd8cd63 req-b724d422-cd8a-463a-b5f2-438048af8a3b service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.157&port_id=30106fe0-df57-4888-b1b7-0efd1cef3638 HTTP/1.1" status: 200  len: 217 time: 0.0595183
Jun 01 06:20:38.252577 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4f1e01e-f649-4310-ad4d-9aab2cd8cd63 req-8fdcb2e0-73eb-4888-af99-bb772454d467 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:38.254054 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d4f1e01e-f649-4310-ad4d-9aab2cd8cd63 req-8fdcb2e0-73eb-4888-af99-bb772454d467 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=207ba625-cb20-4380-b8f8-452b3a0a4864 HTTP/1.1" status: 200  len: 843 time: 0.0610065
Jun 01 06:20:38.330037 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4f1e01e-f649-4310-ad4d-9aab2cd8cd63 req-22a1272b-49c3-4e48-8382-a3c102baa4f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:38.331506 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d4f1e01e-f649-4310-ad4d-9aab2cd8cd63 req-22a1272b-49c3-4e48-8382-a3c102baa4f4 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=a6d7f63e-e70d-44f5-881d-b8b75ee09c7f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1178 time: 0.0709188
Jun 01 06:20:38.341938 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-7d5f7a4b-5ce1-420b-a72b-1f8144068e0b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:38.473142 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d4f1e01e-f649-4310-ad4d-9aab2cd8cd63 req-26f09852-c075-4ecf-8d46-6117ebbde96d service neutron] 10.222.0.48 "GET /v2.0/networks/a6d7f63e-e70d-44f5-881d-b8b75ee09c7f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1343305
Jun 01 06:20:38.614562 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d4f1e01e-f649-4310-ad4d-9aab2cd8cd63 req-75454f5b-6f32-40c0-b7fd-b4feb75c6399 service neutron] 10.222.0.48 "GET /v2.0/networks/a6d7f63e-e70d-44f5-881d-b8b75ee09c7f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1332889
Jun 01 06:20:38.879570 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a59b3af2-acd2-46db-944b-c50707d770cf req-445ea1f1-a74d-4e5e-b802-e60f093c069e tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:38.881103 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a59b3af2-acd2-46db-944b-c50707d770cf req-445ea1f1-a74d-4e5e-b802-e60f093c069e tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.25 "GET /v2.0/ports?device_id=860a551e-b4d2-4e7a-91b7-202cdb9209e8 HTTP/1.1" status: 200  len: 948 time: 0.1846611
Jun 01 06:20:38.932097 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-a59b3af2-acd2-46db-944b-c50707d770cf req-09450908-42e3-4430-813c-9c4e544f23a2 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.25 "GET /v2.0/security-groups?id=978c78c3-4dc2-4d56-8556-630ff2a85083&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433943
Jun 01 06:20:39.054348 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 30106fe0-df57-4888-b1b7-0efd1cef3638 details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:20:39.193905 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 30106fe0-df57-4888-b1b7-0efd1cef3638, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=30106fe0-df57-4888-b1b7-0efd1cef3638,segment=NetworkSegment(2163afda-8422-40f1-8678-56aeadbe45b7),segment_id=2163afda-8422-40f1-8678-56aeadbe45b7)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:20:39.208658 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': '30106fe0-df57-4888-b1b7-0efd1cef3638', 'network_id': 'a6d7f63e-e70d-44f5-881d-b8b75ee09c7f', 'port_id': '30106fe0-df57-4888-b1b7-0efd1cef3638', 'mac_address': 'fa:16:3e:b5:c3:2a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 235, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '207ba625-cb20-4380-b8f8-452b3a0a4864', 'ip_address': '192.168.233.157'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:20:39.265942 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:39.285180 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 30106fe0-df57-4888-b1b7-0efd1cef3638 {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:20:39.301954 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 30106fe0-df57-4888-b1b7-0efd1cef3638, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=30106fe0-df57-4888-b1b7-0efd1cef3638,segment=NetworkSegment(2163afda-8422-40f1-8678-56aeadbe45b7),segment_id=2163afda-8422-40f1-8678-56aeadbe45b7)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:20:39.306793 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:39.309970 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:20:39.383882 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=30106fe0-df57-4888-b1b7-0efd1cef3638,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:20:39.392236 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:39.392583 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:39.392927 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:39.393257 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:39.393586 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:39.393911 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:39.394234 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:39.394555 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:39.394875 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:39.395190 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:39.395507 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:39.395848 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:39.399963 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:20:39.530334 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['30106fe0-df57-4888-b1b7-0efd1cef3638'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:20:40.125887 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d0cecff-41b0-41b1-93c8-c1fc5a4f9959 req-c8277e07-deb9-4781-8229-1dee27d2f4b7 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:40.127372 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7d0cecff-41b0-41b1-93c8-c1fc5a4f9959 req-c8277e07-deb9-4781-8229-1dee27d2f4b7 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.25 "GET /v2.0/ports?device_id=860a551e-b4d2-4e7a-91b7-202cdb9209e8 HTTP/1.1" status: 200  len: 949 time: 0.0813632
Jun 01 06:20:40.174183 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7d0cecff-41b0-41b1-93c8-c1fc5a4f9959 req-c98893a4-c76e-455d-9057-3eb09b51d089 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.25 "GET /v2.0/security-groups?id=978c78c3-4dc2-4d56-8556-630ff2a85083&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408671
Jun 01 06:20:41.059607 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 30106fe0-df57-4888-b1b7-0efd1cef3638 up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:20:41.129671 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning for port 30106fe0-df57-4888-b1b7-0efd1cef3638 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:20:41.134365 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port 30106fe0-df57-4888-b1b7-0efd1cef3638 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:20:41.134742 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:41.269333 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:41.274675 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:41.305062 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '860a551e-b4d2-4e7a-91b7-202cdb9209e8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '30106fe0-df57-4888-b1b7-0efd1cef3638'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:20:41.308184 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5ab6c398-a4c7-4b18-bac1-d038ef3c0f01" -d '{"events": [{"server_uuid": "860a551e-b4d2-4e7a-91b7-202cdb9209e8", "name": "network-vif-plugged", "status": "completed", "tag": "30106fe0-df57-4888-b1b7-0efd1cef3638"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:20:41.319325 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 30106fe0-df57-4888-b1b7-0efd1cef3638, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=30106fe0-df57-4888-b1b7-0efd1cef3638,segment=NetworkSegment(2163afda-8422-40f1-8678-56aeadbe45b7),segment_id=2163afda-8422-40f1-8678-56aeadbe45b7)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:20:41.325215 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:41.329258 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:20:41.371735 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:20:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8b634c29-c195-4395-8be2-57fbadecb625 x-openstack-request-id: req-8b634c29-c195-4395-8be2-57fbadecb625 {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:20:41.372076 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "860a551e-b4d2-4e7a-91b7-202cdb9209e8", "name": "network-vif-plugged", "status": "completed", "tag": "30106fe0-df57-4888-b1b7-0efd1cef3638", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:20:41.372322 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-8b634c29-c195-4395-8be2-57fbadecb625 {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:20:41.372725 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '860a551e-b4d2-4e7a-91b7-202cdb9209e8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '30106fe0-df57-4888-b1b7-0efd1cef3638', 'code': 200}
Jun 01 06:20:41.382281 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c24d1ab-faea-421a-b62f-f3477d1f2faf req-30c329ae-e6d3-4301-b40f-1f129bbc3020 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:41.383945 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7c24d1ab-faea-421a-b62f-f3477d1f2faf req-30c329ae-e6d3-4301-b40f-1f129bbc3020 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.25 "GET /v2.0/ports?device_id=860a551e-b4d2-4e7a-91b7-202cdb9209e8 HTTP/1.1" status: 200  len: 950 time: 0.0927231
Jun 01 06:20:41.412697 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=30106fe0-df57-4888-b1b7-0efd1cef3638,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:20:41.415489 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:20:41.436551 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7c24d1ab-faea-421a-b62f-f3477d1f2faf req-6c0f8023-a9d9-4f8e-b812-e224a9eae007 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.25 "GET /v2.0/security-groups?id=978c78c3-4dc2-4d56-8556-630ff2a85083&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0466340
Jun 01 06:20:41.605202 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07de5fa3-71cf-4869-aad6-97abd272d325 req-92ad7591-7aec-4e84-a09f-f52dbfcdf81b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:41.607055 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-07de5fa3-71cf-4869-aad6-97abd272d325 req-92ad7591-7aec-4e84-a09f-f52dbfcdf81b service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=860a551e-b4d2-4e7a-91b7-202cdb9209e8 HTTP/1.1" status: 200  len: 1103 time: 0.0761731
Jun 01 06:20:41.653358 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-07de5fa3-71cf-4869-aad6-97abd272d325 req-8a079e0b-9126-439c-9307-961862ddc8f1 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=978c78c3-4dc2-4d56-8556-630ff2a85083&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403023
Jun 01 06:20:42.354798 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-7a69df5e-8b4c-4ba8-8751-8f17ddc470b4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:42.642950 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f5e44e4-52af-41d4-939c-48d8f1390501 req-1983c822-e322-4148-945f-116f73357759 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:42.644519 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9f5e44e4-52af-41d4-939c-48d8f1390501 req-1983c822-e322-4148-945f-116f73357759 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.25 "GET /v2.0/ports?device_id=860a551e-b4d2-4e7a-91b7-202cdb9209e8 HTTP/1.1" status: 200  len: 950 time: 0.0848508
Jun 01 06:20:42.690464 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-9f5e44e4-52af-41d4-939c-48d8f1390501 req-d1b61cc7-d8a0-4e72-9a6a-b543fdc251f4 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.25 "GET /v2.0/security-groups?id=978c78c3-4dc2-4d56-8556-630ff2a85083&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400801
Jun 01 06:20:43.147310 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bb70edc-566b-426c-a371-9d31a88bee45 req-86a27bd6-4ec5-4266-b58d-0f1ee8bdc976 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:43.148849 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3bb70edc-566b-426c-a371-9d31a88bee45 req-86a27bd6-4ec5-4266-b58d-0f1ee8bdc976 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.25 "GET /v2.0/ports?device_id=860a551e-b4d2-4e7a-91b7-202cdb9209e8 HTTP/1.1" status: 200  len: 950 time: 0.0889599
Jun 01 06:20:43.197717 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3bb70edc-566b-426c-a371-9d31a88bee45 req-bc50a0f7-0fa6-457c-a41e-7f5f31c254ab tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.25 "GET /v2.0/security-groups?id=978c78c3-4dc2-4d56-8556-630ff2a85083&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0411780
Jun 01 06:20:43.290410 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:44.454518 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e5d7cc7-0ffa-4b6b-866d-21f29f987bb0 req-fd81b150-7a56-4a41-b70e-33c4889e1c55 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:44.456146 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4e5d7cc7-0ffa-4b6b-866d-21f29f987bb0 req-fd81b150-7a56-4a41-b70e-33c4889e1c55 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.25 "GET /v2.0/ports?device_id=860a551e-b4d2-4e7a-91b7-202cdb9209e8 HTTP/1.1" status: 200  len: 950 time: 0.1450377
Jun 01 06:20:44.469233 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2399328f-c8e9-4422-8dc7-bb4c29af1a95 req-4e272a8d-737e-4d89-a0ee-cb11efff063c tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:44.470800 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2399328f-c8e9-4422-8dc7-bb4c29af1a95 req-4e272a8d-737e-4d89-a0ee-cb11efff063c tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.48 "GET /v2.0/ports?device_id=860a551e-b4d2-4e7a-91b7-202cdb9209e8 HTTP/1.1" status: 200  len: 950 time: 0.1263080
Jun 01 06:20:44.569625 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4e5d7cc7-0ffa-4b6b-866d-21f29f987bb0 req-6815101c-52e6-4eb6-861d-dc3fc8be0ed9 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.25 "GET /v2.0/security-groups?id=978c78c3-4dc2-4d56-8556-630ff2a85083&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0979540
Jun 01 06:20:44.641291 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-2399328f-c8e9-4422-8dc7-bb4c29af1a95 req-62f52469-5117-40d7-b2b3-a7d8132c5481 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Deleting port 30106fe0-df57-4888-b1b7-0efd1cef3638 {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:20:44.641635 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-2399328f-c8e9-4422-8dc7-bb4c29af1a95 req-62f52469-5117-40d7-b2b3-a7d8132c5481 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:44.724616 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:20:44.779541 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-2399328f-c8e9-4422-8dc7-bb4c29af1a95 req-62f52469-5117-40d7-b2b3-a7d8132c5481 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] For port 30106fe0-df57-4888-b1b7-0efd1cef3638, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=30106fe0-df57-4888-b1b7-0efd1cef3638,segment=NetworkSegment(2163afda-8422-40f1-8678-56aeadbe45b7),segment_id=2163afda-8422-40f1-8678-56aeadbe45b7)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:20:44.779967 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-2399328f-c8e9-4422-8dc7-bb4c29af1a95 req-62f52469-5117-40d7-b2b3-a7d8132c5481 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:44.919872 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-2399328f-c8e9-4422-8dc7-bb4c29af1a95 req-62f52469-5117-40d7-b2b3-a7d8132c5481 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Calling delete_port for 30106fe0-df57-4888-b1b7-0efd1cef3638 owned by compute:nova {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:20:45.037100 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-2399328f-c8e9-4422-8dc7-bb4c29af1a95 req-62f52469-5117-40d7-b2b3-a7d8132c5481 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:45.043897 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b86bd8da-46a3-4f77-9883-830d53d63fd5 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:20:45.049360 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['30106fe0-df57-4888-b1b7-0efd1cef3638'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:20:45.091140 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62f52469-5117-40d7-b2b3-a7d8132c5481 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Pushing event deleted for resources: {'Port': ['ID=30106fe0-df57-4888-b1b7-0efd1cef3638,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:20:45.133900 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62f52469-5117-40d7-b2b3-a7d8132c5481 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:45.134274 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62f52469-5117-40d7-b2b3-a7d8132c5481 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:45.134637 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62f52469-5117-40d7-b2b3-a7d8132c5481 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:45.135011 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62f52469-5117-40d7-b2b3-a7d8132c5481 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:45.135382 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62f52469-5117-40d7-b2b3-a7d8132c5481 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:45.135743 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62f52469-5117-40d7-b2b3-a7d8132c5481 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:45.136116 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62f52469-5117-40d7-b2b3-a7d8132c5481 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:45.136461 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62f52469-5117-40d7-b2b3-a7d8132c5481 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:45.136804 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62f52469-5117-40d7-b2b3-a7d8132c5481 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:45.137147 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62f52469-5117-40d7-b2b3-a7d8132c5481 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:45.137489 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62f52469-5117-40d7-b2b3-a7d8132c5481 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:45.137833 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62f52469-5117-40d7-b2b3-a7d8132c5481 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:20:45.169190 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-62f52469-5117-40d7-b2b3-a7d8132c5481 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:20:45.182218 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-2399328f-c8e9-4422-8dc7-bb4c29af1a95 req-62f52469-5117-40d7-b2b3-a7d8132c5481 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] No DVR routers for this DVR port 30106fe0-df57-4888-b1b7-0efd1cef3638 on host hv-cinder-79388 {{(pid=92229) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:20:45.185560 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-2399328f-c8e9-4422-8dc7-bb4c29af1a95 req-62f52469-5117-40d7-b2b3-a7d8132c5481 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:45.188653 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '860a551e-b4d2-4e7a-91b7-202cdb9209e8', 'name': 'network-vif-deleted', 'tag': '30106fe0-df57-4888-b1b7-0efd1cef3638'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:20:45.191492 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-308e076e-6766-4103-9664-483ec43ce524" -d '{"events": [{"server_uuid": "860a551e-b4d2-4e7a-91b7-202cdb9209e8", "name": "network-vif-deleted", "tag": "30106fe0-df57-4888-b1b7-0efd1cef3638"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:20:45.208044 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2399328f-c8e9-4422-8dc7-bb4c29af1a95 req-62f52469-5117-40d7-b2b3-a7d8132c5481 tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.48 "DELETE /v2.0/ports/30106fe0-df57-4888-b1b7-0efd1cef3638 HTTP/1.1" status: 204  len: 173 time: 0.7227380
Jun 01 06:20:45.238021 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:20:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-54138c12-9f35-4e35-80c2-436b110dd74d x-openstack-request-id: req-54138c12-9f35-4e35-80c2-436b110dd74d {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:20:45.238820 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "860a551e-b4d2-4e7a-91b7-202cdb9209e8", "name": "network-vif-deleted", "tag": "30106fe0-df57-4888-b1b7-0efd1cef3638", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:20:45.238820 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-54138c12-9f35-4e35-80c2-436b110dd74d {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:20:45.239223 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '860a551e-b4d2-4e7a-91b7-202cdb9209e8', 'name': 'network-vif-deleted', 'tag': '30106fe0-df57-4888-b1b7-0efd1cef3638', 'status': 'completed', 'code': 200}
Jun 01 06:20:45.389485 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:45.746502 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-b68bee57-e355-4d93-adad-10b46b0dae57 req-2927ffdf-b534-48a3-80e4-4f2ab9c341ea tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Synchronizing usage tracker for tenant:eab2be7258544f5194b374fd04d4a3f4 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:20:45.763064 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-b68bee57-e355-4d93-adad-10b46b0dae57 req-2927ffdf-b534-48a3-80e4-4f2ab9c341ea tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] Unset dirty status for tenant:eab2be7258544f5194b374fd04d4a3f4 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:20:45.764245 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b68bee57-e355-4d93-adad-10b46b0dae57 req-2927ffdf-b534-48a3-80e4-4f2ab9c341ea tempest-VolumesNegativeTest-1623212551 tempest-VolumesNegativeTest-1623212551-project] 10.222.0.25 "GET /v2.0/ports?device_id=860a551e-b4d2-4e7a-91b7-202cdb9209e8 HTTP/1.1" status: 200  len: 210 time: 0.0622349
Jun 01 06:20:46.031905 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:47.095655 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 30106fe0-df57-4888-b1b7-0efd1cef3638 no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:20:47.131971 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] No Port match for: 30106fe0-df57-4888-b1b7-0efd1cef3638 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:20:47.132169 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 30106fe0-df57-4888-b1b7-0efd1cef3638 not bound to the agent host hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:20:49.745692 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5d0ff823-9eb2-4f72-b292-aeb4d041ca36 req-6d641947-38e1-4a0e-bbc5-7849bde59e42 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0720508
Jun 01 06:20:49.853418 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d0ff823-9eb2-4f72-b292-aeb4d041ca36 req-a75dbd0f-19d4-417e-b056-afc1e8d93e8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:49.855502 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5d0ff823-9eb2-4f72-b292-aeb4d041ca36 req-a75dbd0f-19d4-417e-b056-afc1e8d93e8c service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=e8bcff3fed924886a68a8562a9f4f8f3&device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 1098 time: 0.0851555
Jun 01 06:20:50.122463 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d0ff823-9eb2-4f72-b292-aeb4d041ca36 req-7b64b8fe-524c-419c-a249-7e90f8e80499 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:50.123900 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5d0ff823-9eb2-4f72-b292-aeb4d041ca36 req-7b64b8fe-524c-419c-a249-7e90f8e80499 service neutron] 10.222.0.48 "GET /v2.0/networks?id=028fef0a-f05a-48d5-ba5c-b539846209ba HTTP/1.1" status: 200  len: 912 time: 0.2496824
Jun 01 06:20:50.230782 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5d0ff823-9eb2-4f72-b292-aeb4d041ca36 req-06f04ec4-5035-4b8f-bbd7-59b463b01b85 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=5fa581a1-474d-4dc6-a414-36e7324b8555 HTTP/1.1" status: 200  len: 1001 time: 0.1005421
Jun 01 06:20:50.294574 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d0ff823-9eb2-4f72-b292-aeb4d041ca36 req-31cf9980-38b3-4e1b-98f9-770a07122df5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:50.296052 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5d0ff823-9eb2-4f72-b292-aeb4d041ca36 req-31cf9980-38b3-4e1b-98f9-770a07122df5 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=cdffe000-7f35-495d-a741-b4c48a060887 HTTP/1.1" status: 200  len: 850 time: 0.0595548
Jun 01 06:20:50.372256 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d0ff823-9eb2-4f72-b292-aeb4d041ca36 req-417d1e1c-a40b-4489-98e6-c65bdae7878c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:50.373787 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5d0ff823-9eb2-4f72-b292-aeb4d041ca36 req-417d1e1c-a40b-4489-98e6-c65bdae7878c service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=028fef0a-f05a-48d5-ba5c-b539846209ba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0715075
Jun 01 06:20:50.509750 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5d0ff823-9eb2-4f72-b292-aeb4d041ca36 req-fe25443b-128f-4c2e-a1fe-0afd4c3f3b76 service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1293824
Jun 01 06:20:50.651226 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5d0ff823-9eb2-4f72-b292-aeb4d041ca36 req-a8944dfc-b904-4698-94ce-3121185f1afe service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1347578
Jun 01 06:20:51.672834 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 41646) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:20:51.827301 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-bba91149-677c-48bc-9fb8-133851464657 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=eab2be7258544f5194b374fd04d4a3f4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1532357
Jun 01 06:20:51.829621 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 41652) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:20:51.890652 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-367f7a51-2595-4bb7-b812-4b9a4d60ebe1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:51.922200 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-367f7a51-2595-4bb7-b812-4b9a4d60ebe1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:51.976229 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-367f7a51-2595-4bb7-b812-4b9a4d60ebe1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:51.982465 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-0d2b03e2-8531-40ab-b8f5-cc46334fb3a7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:20:51.997228 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-367f7a51-2595-4bb7-b812-4b9a4d60ebe1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=978c78c3-4dc2-4d56-8556-630ff2a85083,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:20:52.000182 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-367f7a51-2595-4bb7-b812-4b9a4d60ebe1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:20:52.006740 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-367f7a51-2595-4bb7-b812-4b9a4d60ebe1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:52.007877 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-367f7a51-2595-4bb7-b812-4b9a4d60ebe1 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/978c78c3-4dc2-4d56-8556-630ff2a85083 HTTP/1.1" status: 204  len: 168 time: 0.1773517
Jun 01 06:20:52.742034 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 41676) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:20:52.862279 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1675289896-network', 'tenant_id': 'e4915685ec04413092ab2058fb1fa324'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:20:52.868678 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:20:52.873536 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Usage tracker for resource:network and tenant:e4915685ec04413092ab2058fb1fa324 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:20:52.876576 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:20:52.883347 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:20:52.895509 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Made reservation on behalf of e4915685ec04413092ab2058fb1fa324 for: {'network': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:20:52.898168 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-8110114'] for network, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:52.914712 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:52.930577 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:20:52.935711 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Usage tracker for resource:security_group_rule and tenant:e4915685ec04413092ab2058fb1fa324 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:20:52.939028 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:20:52.945022 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:20:53.045878 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:53.049827 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:53.052879 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-3e196e12-9c7d-4597-b628-2b132274156f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:20:53.083696 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] vlan segment allocate from pool success with {'vlan_id': 221, 'physical_network': 'physnet1'}  {{(pid=92229) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 06:20:53.093419 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=23991ca1-e8b0-4439-8006-3ce171b2642b,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:20:53.097212 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:20:53.099941 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:53.100285 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.db.segments_db [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Added segment 8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e of type vlan for network 4d8cd222-c2f9-4d3c-934c-dba6dfa184ac
Jun 01 06:20:53.129037 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8788496565589'] for network, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:53.166393 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104'] for network, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:53.167931 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:53.168521 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:53.172086 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:20:53.283574 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] 10.222.0.25 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 0.5404453
Jun 01 06:20:53.284488 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Pushing event updated for resources: {'Network': ['ID=4d8cd222-c2f9-4d3c-934c-dba6dfa184ac,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:20:53.286620 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 41682) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:20:53.289661 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-e8ce1612-1f05-4734-adab-e8437d56e426 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:20:53.293961 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [None req-114dcb88-8627-415c-b5d3-4f12e8469055 admin admin] Request body: {'subnet': {'network_id': '4d8cd222-c2f9-4d3c-934c-dba6dfa184ac', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1675289896-subnet', 'tenant_id': 'e4915685ec04413092ab2058fb1fa324', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:20:53.296228 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Network 4d8cd222-c2f9-4d3c-934c-dba6dfa184ac details requested by agent ovs-agent-dv-cinder-793885-1-iscsi with host dv-cinder-793885-1-iscsi {{(pid=92231) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 06:20:53.298930 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-114dcb88-8627-415c-b5d3-4f12e8469055 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:20:53.303039 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-114dcb88-8627-415c-b5d3-4f12e8469055 admin admin] Usage tracker for resource:subnet and tenant:e4915685ec04413092ab2058fb1fa324 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:20:53.306149 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [None req-114dcb88-8627-415c-b5d3-4f12e8469055 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:20:53.315182 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [None req-114dcb88-8627-415c-b5d3-4f12e8469055 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:20:53.326019 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-114dcb88-8627-415c-b5d3-4f12e8469055 admin admin] Made reservation on behalf of e4915685ec04413092ab2058fb1fa324 for: {'subnet': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:20:53.328647 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-114dcb88-8627-415c-b5d3-4f12e8469055 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2134721'] for subnet, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:53.753107 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-114dcb88-8627-415c-b5d3-4f12e8469055 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1981522', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2134743'] for subnet, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:53.757205 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-d8763359-6b1a-4f86-83d9-c57e8dabb452 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:20:53.828780 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-114dcb88-8627-415c-b5d3-4f12e8469055 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d6fc7f9a-efe9-45b9-9679-8f49743dcb31,revision_number=0']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:20:53.834393 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-114dcb88-8627-415c-b5d3-4f12e8469055 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:20:53.841749 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-114dcb88-8627-415c-b5d3-4f12e8469055 admin admin] Checking segment: {'id': '8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 221, 'network_id': '4d8cd222-c2f9-4d3c-934c-dba6dfa184ac'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:20:53.842102 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-114dcb88-8627-415c-b5d3-4f12e8469055 admin admin] Network hostable DHCP agents. Network: 4d8cd222-c2f9-4d3c-934c-dba6dfa184ac, hostable agents: ['648832f0-f26e-4e29-ac0d-d97e4a75c6c4'], hosted agents: [] {{(pid=92229) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 06:20:53.861190 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-114dcb88-8627-415c-b5d3-4f12e8469055 admin admin] Network 4d8cd222-c2f9-4d3c-934c-dba6dfa184ac is scheduled to be hosted by DHCP agent 648832f0-f26e-4e29-ac0d-d97e4a75c6c4 with binding_index 1 {{(pid=92229) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 06:20:53.872245 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [None req-114dcb88-8627-415c-b5d3-4f12e8469055 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793885-1-iscsi, 4d8cd222-c2f9-4d3c-934c-dba6dfa184ac) {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:20:53.882808 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-504fe7df-7726-48a6-8279-f0267d1f8702 None None] Network 4d8cd222-c2f9-4d3c-934c-dba6dfa184ac requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:20:53.883493 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-114dcb88-8627-415c-b5d3-4f12e8469055 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:53.884159 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-114dcb88-8627-415c-b5d3-4f12e8469055 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:53.907930 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-114dcb88-8627-415c-b5d3-4f12e8469055 admin admin] 10.222.0.25 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 0.6193266
Jun 01 06:20:54.156035 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b72b8a54-817c-4e47-b85d-aa93eaf5bf44 None None] Network 4d8cd222-c2f9-4d3c-934c-dba6dfa184ac requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:20:56.015707 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-a9ab6fd4-ff50-4928-b951-29383cbab247 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:56.016393 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-a9ab6fd4-ff50-4928-b951-29383cbab247 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Synchronizing usage tracker for tenant:e4915685ec04413092ab2058fb1fa324 on resource:network {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:20:56.033399 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-a9ab6fd4-ff50-4928-b951-29383cbab247 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Unset dirty status for tenant:e4915685ec04413092ab2058fb1fa324 on resource:network {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:20:56.034618 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-a9ab6fd4-ff50-4928-b951-29383cbab247 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/networks?id=4d8cd222-c2f9-4d3c-934c-dba6dfa184ac HTTP/1.1" status: 200  len: 814 time: 0.1796176
Jun 01 06:20:56.049832 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-7b930e3f-0457-44c0-95cf-46d705067587 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/quotas/e4915685ec04413092ab2058fb1fa324 HTTP/1.1" status: 200  len: 375 time: 0.0096803
Jun 01 06:20:56.096249 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-2a30fcb1-9435-4612-82db-744abc5fe8e8 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=e4915685ec04413092ab2058fb1fa324&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0413067
Jun 01 06:20:56.328025 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-b2b70dc1-1095-4d5e-8da4-6f16c86f131f service neutron] 10.222.0.25 "GET /v2.0/networks/4d8cd222-c2f9-4d3c-934c-dba6dfa184ac?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2250707
Jun 01 06:20:56.464568 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-f4b53d48-3931-4c24-a101-72f52ab35bfd service neutron] 10.222.0.25 "GET /v2.0/networks/4d8cd222-c2f9-4d3c-934c-dba6dfa184ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1307192
Jun 01 06:20:56.644565 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-cb7cdbaa-f7ef-43f8-b178-90040caff0a0 req-eda3d8e7-d07b-402d-b1f8-a9a0dd1ebcce tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=31268529-11c5-4481-a0db-bbace95bfe27 HTTP/1.1" status: 200  len: 210 time: 0.0439625
Jun 01 06:20:57.692405 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-afbe37f1-1a5c-48c5-a61a-db497b62addd tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:57.693922 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-afbe37f1-1a5c-48c5-a61a-db497b62addd tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.48 "GET /v2.0/networks?id=4d8cd222-c2f9-4d3c-934c-dba6dfa184ac HTTP/1.1" status: 200  len: 814 time: 0.1666524
Jun 01 06:20:57.707056 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-28c6c356-7c1a-49ef-8c1c-bfa89bf03f97 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Request body: {'port': {'device_id': '31268529-11c5-4481-a0db-bbace95bfe27', 'network_id': '4d8cd222-c2f9-4d3c-934c-dba6dfa184ac', 'admin_state_up': True, 'tenant_id': 'e4915685ec04413092ab2058fb1fa324'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:20:57.838468 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-039308a2-0e69-4135-ab2e-9d7ed9e9e5d7 req-908d8caa-7e58-44ca-b010-08ccc20e0c50 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=31268529-11c5-4481-a0db-bbace95bfe27 HTTP/1.1" status: 200  len: 210 time: 0.0568471
Jun 01 06:20:57.887843 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-28c6c356-7c1a-49ef-8c1c-bfa89bf03f97 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:20:57.891576 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-28c6c356-7c1a-49ef-8c1c-bfa89bf03f97 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Usage tracker for resource:port and tenant:e4915685ec04413092ab2058fb1fa324 is out of sync, need to count used quota {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 06:20:57.894365 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-28c6c356-7c1a-49ef-8c1c-bfa89bf03f97 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92229) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 06:20:57.900077 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-28c6c356-7c1a-49ef-8c1c-bfa89bf03f97 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:20:57.910321 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-28c6c356-7c1a-49ef-8c1c-bfa89bf03f97 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Made reservation on behalf of e4915685ec04413092ab2058fb1fa324 for: {'port': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:20:57.913857 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-28c6c356-7c1a-49ef-8c1c-bfa89bf03f97 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:58.075311 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-28c6c356-7c1a-49ef-8c1c-bfa89bf03f97 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Allocated IP 172.20.0.14 (4d8cd222-c2f9-4d3c-934c-dba6dfa184ac/d6fc7f9a-efe9-45b9-9679-8f49743dcb31/b9282008-074c-414a-9a07-9a49782d2a84) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:20:58.285542 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-28c6c356-7c1a-49ef-8c1c-bfa89bf03f97 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:58.315967 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-28c6c356-7c1a-49ef-8c1c-bfa89bf03f97 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:58.321335 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-1e2a7819-acc1-4945-9225-40d6801e71d3 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:20:58.387635 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-28c6c356-7c1a-49ef-8c1c-bfa89bf03f97 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Network 4d8cd222-c2f9-4d3c-934c-dba6dfa184ac is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:20:58.390723 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-28c6c356-7c1a-49ef-8c1c-bfa89bf03f97 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:20:58.394378 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-28c6c356-7c1a-49ef-8c1c-bfa89bf03f97 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:20:58.426067 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28c6c356-7c1a-49ef-8c1c-bfa89bf03f97 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Pushing event updated for resources: {'Port': ['ID=b9282008-074c-414a-9a07-9a49782d2a84,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:20:58.432806 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-28c6c356-7c1a-49ef-8c1c-bfa89bf03f97 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:20:58.464554 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-28c6c356-7c1a-49ef-8c1c-bfa89bf03f97 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:58.465154 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-28c6c356-7c1a-49ef-8c1c-bfa89bf03f97 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:58.486462 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-28c6c356-7c1a-49ef-8c1c-bfa89bf03f97 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.7834527
Jun 01 06:20:58.498349 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] Request body: {'port': {'device_id': '31268529-11c5-4481-a0db-bbace95bfe27', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79388'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:20:58.612283 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:59.110926 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b9282008-074c-414a-9a07-9a49782d2a84 {{(pid=92229) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:20:59.125370 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:59.146050 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] Transition to ACTIVE for port object b9282008-074c-414a-9a07-9a49782d2a84 will not be triggered until provisioned by entity L2. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:20:59.150297 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2077419'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:59.156239 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-4bb08104-8e31-4abe-b9cd-8102ba7929c4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:20:59.288994 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fee215f2-68c0-4468-a36d-c053aa0e2018 req-7d8e13dd-72dd-4db3-b8df-30ea4259bbbd tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:59.289690 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-fee215f2-68c0-4468-a36d-c053aa0e2018 req-7d8e13dd-72dd-4db3-b8df-30ea4259bbbd tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Synchronizing usage tracker for tenant:e4915685ec04413092ab2058fb1fa324 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:20:59.341652 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] Pushing event updated for resources: {'Port': ['ID=b9282008-074c-414a-9a07-9a49782d2a84,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:20:59.351345 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.195s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:20:59.388617 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-fee215f2-68c0-4468-a36d-c053aa0e2018 req-7d8e13dd-72dd-4db3-b8df-30ea4259bbbd tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Unset dirty status for tenant:e4915685ec04413092ab2058fb1fa324 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:20:59.389681 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fee215f2-68c0-4468-a36d-c053aa0e2018 req-7d8e13dd-72dd-4db3-b8df-30ea4259bbbd tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=31268529-11c5-4481-a0db-bbace95bfe27 HTTP/1.1" status: 200  len: 932 time: 0.4340460
Jun 01 06:20:59.458965 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-fee215f2-68c0-4468-a36d-c053aa0e2018 req-ea0833ea-1716-40e2-a5bf-5588993e8428 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Synchronizing usage tracker for tenant:e4915685ec04413092ab2058fb1fa324 on resource:security_group {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:20:59.461418 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] Attempting to bind port b9282008-074c-414a-9a07-9a49782d2a84 on host hv-cinder-79388 for vnic_type normal with profile  {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:20:59.461750 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] Attempting to bind port b9282008-074c-414a-9a07-9a49782d2a84 by drivers openvswitch,hyperv on host hv-cinder-79388 at level 0 using segments [{'id': '8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 221, 'network_id': '4d8cd222-c2f9-4d3c-934c-dba6dfa184ac'}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:20:59.462073 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] Attempting to bind port b9282008-074c-414a-9a07-9a49782d2a84 on network 4d8cd222-c2f9-4d3c-934c-dba6dfa184ac {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:20:59.471645 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] Port b9282008-074c-414a-9a07-9a49782d2a84 on network 4d8cd222-c2f9-4d3c-934c-dba6dfa184ac not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79388 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 06:20:59.471994 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] Attempting to bind port b9282008-074c-414a-9a07-9a49782d2a84 on network 4d8cd222-c2f9-4d3c-934c-dba6dfa184ac {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:20:59.482832 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] Checking agent: {'id': '56148394-2131-4d06-bcfa-c032301591b8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79388', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'started_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 20, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:20:59.483180 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] Checking segment: {'id': '8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 221, 'network_id': '4d8cd222-c2f9-4d3c-934c-dba6dfa184ac'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:20:59.483551 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] Bound using segment: {'id': '8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 221, 'network_id': '4d8cd222-c2f9-4d3c-934c-dba6dfa184ac'} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:20:59.484009 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] Bound port: b9282008-074c-414a-9a07-9a49782d2a84, host: hv-cinder-79388, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 221, 'network_id': '4d8cd222-c2f9-4d3c-934c-dba6dfa184ac'}}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:20:59.484355 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:59.531637 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-fee215f2-68c0-4468-a36d-c053aa0e2018 req-ea0833ea-1716-40e2-a5bf-5588993e8428 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Unset dirty status for tenant:e4915685ec04413092ab2058fb1fa324 on resource:security_group {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:20:59.532793 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fee215f2-68c0-4468-a36d-c053aa0e2018 req-ea0833ea-1716-40e2-a5bf-5588993e8428 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/security-groups?id=23991ca1-e8b0-4439-8006-3ce171b2642b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1368473
Jun 01 06:20:59.585183 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] For port b9282008-074c-414a-9a07-9a49782d2a84, host hv-cinder-79388, cleared binding levels {{(pid=92229) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:20:59.589596 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] For port b9282008-074c-414a-9a07-9a49782d2a84, host hv-cinder-79388, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=b9282008-074c-414a-9a07-9a49782d2a84,segment=NetworkSegment(8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e),segment_id=8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e)] {{(pid=92229) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:20:59.593962 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2077419'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:59.599124 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-41f2ff77-77a6-4b8c-b476-82efd7782465 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:20:59.658233 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:59.658844 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:20:59.660226 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] 10.222.0.48 "PUT /v2.0/ports/b9282008-074c-414a-9a07-9a49782d2a84 HTTP/1.1" status: 200  len: 1094 time: 1.1662076
Jun 01 06:20:59.660728 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '31268529-11c5-4481-a0db-bbace95bfe27', 'tag': 'b9282008-074c-414a-9a07-9a49782d2a84'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:20:59.662997 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d1ef355f-fb3b-4eb1-9162-912a08ef7c18" -d '{"events": [{"name": "network-changed", "server_uuid": "31268529-11c5-4481-a0db-bbace95bfe27", "tag": "b9282008-074c-414a-9a07-9a49782d2a84"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:20:59.680979 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] Pushing event updated for resources: {'Port': ['ID=b9282008-074c-414a-9a07-9a49782d2a84,revision_number=3']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:20:59.685059 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-f0f28f34-1b15-4051-9dba-be1e8c754609 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:20:59.733664 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:20:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2276a57d-00c8-4c33-abd5-8e0599dbc599 x-openstack-request-id: req-2276a57d-00c8-4c33-abd5-8e0599dbc599 {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:20:59.733986 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "31268529-11c5-4481-a0db-bbace95bfe27", "tag": "b9282008-074c-414a-9a07-9a49782d2a84", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:20:59.734275 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-2276a57d-00c8-4c33-abd5-8e0599dbc599 {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:20:59.734697 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '31268529-11c5-4481-a0db-bbace95bfe27', 'tag': 'b9282008-074c-414a-9a07-9a49782d2a84', 'status': 'completed', 'code': 200}
Jun 01 06:20:59.775798 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-b2f95315-28d0-451c-9165-fd0d5a15a095 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:59.777487 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-b2f95315-28d0-451c-9165-fd0d5a15a095 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=e4915685ec04413092ab2058fb1fa324&device_id=31268529-11c5-4481-a0db-bbace95bfe27 HTTP/1.1" status: 200  len: 1097 time: 0.0783625
Jun 01 06:20:59.853707 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-d5b451c7-fb30-4cac-8d4d-98f244b637c4 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b9282008-074c-414a-9a07-9a49782d2a84 HTTP/1.1" status: 200  len: 217 time: 0.0690868
Jun 01 06:20:59.915339 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-2d9ba194-8711-4f9d-8175-8864e7b14239 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:20:59.916771 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-2d9ba194-8711-4f9d-8175-8864e7b14239 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=d6fc7f9a-efe9-45b9-9679-8f49743dcb31 HTTP/1.1" status: 200  len: 854 time: 0.0572712
Jun 01 06:20:59.963479 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-21f1f5a3-0613-4b63-a9e5-a7cfebb15a8f service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=4d8cd222-c2f9-4d3c-934c-dba6dfa184ac&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0407856
Jun 01 06:21:00.095013 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-fe3bac27-c624-4b96-b95d-70c68d039e76 service neutron] 10.222.0.48 "GET /v2.0/networks/4d8cd222-c2f9-4d3c-934c-dba6dfa184ac?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1247444
Jun 01 06:21:00.232224 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3c86c174-06b8-4752-aff1-6a1cf35a0960 req-599126b8-22bc-45a1-9950-3b30117440d6 service neutron] 10.222.0.48 "GET /v2.0/networks/4d8cd222-c2f9-4d3c-934c-dba6dfa184ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1307871
Jun 01 06:21:00.359977 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1ef355f-fb3b-4eb1-9162-912a08ef7c18 req-1a19fd81-01c6-4ce4-a2fe-06fdef03089f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:00.361448 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d1ef355f-fb3b-4eb1-9162-912a08ef7c18 req-1a19fd81-01c6-4ce4-a2fe-06fdef03089f service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=e4915685ec04413092ab2058fb1fa324&device_id=31268529-11c5-4481-a0db-bbace95bfe27 HTTP/1.1" status: 200  len: 1097 time: 0.0818958
Jun 01 06:21:00.494408 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1ef355f-fb3b-4eb1-9162-912a08ef7c18 req-be9e1e79-bae2-47f3-8b3e-f669a95b921b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:00.495803 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d1ef355f-fb3b-4eb1-9162-912a08ef7c18 req-be9e1e79-bae2-47f3-8b3e-f669a95b921b service neutron] 10.222.0.48 "GET /v2.0/networks?id=4d8cd222-c2f9-4d3c-934c-dba6dfa184ac HTTP/1.1" status: 200  len: 915 time: 0.1263895
Jun 01 06:21:00.562708 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d1ef355f-fb3b-4eb1-9162-912a08ef7c18 req-b13569c3-9cd5-46a2-8774-3e5e3e9ffc95 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b9282008-074c-414a-9a07-9a49782d2a84 HTTP/1.1" status: 200  len: 217 time: 0.0602238
Jun 01 06:21:00.633379 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1ef355f-fb3b-4eb1-9162-912a08ef7c18 req-fb78eb37-546b-452f-b7c7-deac45e5efba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:00.634834 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d1ef355f-fb3b-4eb1-9162-912a08ef7c18 req-fb78eb37-546b-452f-b7c7-deac45e5efba service neutron] 10.222.0.48 "GET /v2.0/subnets?id=d6fc7f9a-efe9-45b9-9679-8f49743dcb31 HTTP/1.1" status: 200  len: 854 time: 0.0655041
Jun 01 06:21:00.723777 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d1ef355f-fb3b-4eb1-9162-912a08ef7c18 req-b63e9794-b431-4e48-9839-b0221fb99af9 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=4d8cd222-c2f9-4d3c-934c-dba6dfa184ac&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0807884
Jun 01 06:21:00.951323 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d0b46ef-7600-4485-ba10-7816f6d9fbfb req-5d888610-ff49-4a90-b4e6-9f50bdce7c6f tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:00.952782 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1d0b46ef-7600-4485-ba10-7816f6d9fbfb req-5d888610-ff49-4a90-b4e6-9f50bdce7c6f tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=31268529-11c5-4481-a0db-bbace95bfe27 HTTP/1.1" status: 200  len: 944 time: 0.3115518
Jun 01 06:21:00.985881 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d1ef355f-fb3b-4eb1-9162-912a08ef7c18 req-288650a9-bc64-44e2-a8fc-741c255aaf54 service neutron] 10.222.0.48 "GET /v2.0/networks/4d8cd222-c2f9-4d3c-934c-dba6dfa184ac?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2529845
Jun 01 06:21:01.076839 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1d0b46ef-7600-4485-ba10-7816f6d9fbfb req-3cdd04d2-55cc-4293-9be7-ee12691f2dad tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/security-groups?id=23991ca1-e8b0-4439-8006-3ce171b2642b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1149299
Jun 01 06:21:01.133693 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d1ef355f-fb3b-4eb1-9162-912a08ef7c18 req-9082013f-f5be-4d70-9df8-18349e9bbf41 service neutron] 10.222.0.48 "GET /v2.0/networks/4d8cd222-c2f9-4d3c-934c-dba6dfa184ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1365671
Jun 01 06:21:02.273054 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b45b1cec-1aad-4d7d-bc67-9f6eb71af656 req-914a1244-f4b6-42be-9ae9-cb17a39a37a3 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:02.274566 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b45b1cec-1aad-4d7d-bc67-9f6eb71af656 req-914a1244-f4b6-42be-9ae9-cb17a39a37a3 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=31268529-11c5-4481-a0db-bbace95bfe27 HTTP/1.1" status: 200  len: 944 time: 0.0893619
Jun 01 06:21:02.318473 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-b45b1cec-1aad-4d7d-bc67-9f6eb71af656 req-a063b00c-33c5-4042-9785-8392d86b5c1a tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/security-groups?id=23991ca1-e8b0-4439-8006-3ce171b2642b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0373085
Jun 01 06:21:03.189092 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device b9282008-074c-414a-9a07-9a49782d2a84 details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:21:03.332364 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port b9282008-074c-414a-9a07-9a49782d2a84, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=b9282008-074c-414a-9a07-9a49782d2a84,segment=NetworkSegment(8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e),segment_id=8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:21:03.346752 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': 'b9282008-074c-414a-9a07-9a49782d2a84', 'network_id': '4d8cd222-c2f9-4d3c-934c-dba6dfa184ac', 'port_id': 'b9282008-074c-414a-9a07-9a49782d2a84', 'mac_address': 'fa:16:3e:97:1e:2e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 221, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd6fc7f9a-efe9-45b9-9679-8f49743dcb31', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:21:03.406771 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:03.424267 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b9282008-074c-414a-9a07-9a49782d2a84 {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:21:03.440495 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port b9282008-074c-414a-9a07-9a49782d2a84, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=b9282008-074c-414a-9a07-9a49782d2a84,segment=NetworkSegment(8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e),segment_id=8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:21:03.444893 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:03.448050 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:21:03.510361 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a9d0a81-7c33-451d-975d-a6d44dfcc12a req-c780cc51-f431-48b4-96af-9c04bc1575c4 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:03.511836 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0a9d0a81-7c33-451d-975d-a6d44dfcc12a req-c780cc51-f431-48b4-96af-9c04bc1575c4 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=31268529-11c5-4481-a0db-bbace95bfe27 HTTP/1.1" status: 200  len: 945 time: 0.0854301
Jun 01 06:21:03.514705 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=b9282008-074c-414a-9a07-9a49782d2a84,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:21:03.517724 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:21:03.559405 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0a9d0a81-7c33-451d-975d-a6d44dfcc12a req-44c2e73f-f24c-4866-b409-93e690c72eeb tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/security-groups?id=23991ca1-e8b0-4439-8006-3ce171b2642b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392342
Jun 01 06:21:03.656642 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['b9282008-074c-414a-9a07-9a49782d2a84'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:21:04.755033 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f31d33c4-1bda-472b-99ab-fba9632a2f29 req-884666c3-0578-497b-b221-78cb965e7263 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:04.756514 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f31d33c4-1bda-472b-99ab-fba9632a2f29 req-884666c3-0578-497b-b221-78cb965e7263 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=31268529-11c5-4481-a0db-bbace95bfe27 HTTP/1.1" status: 200  len: 945 time: 0.0813892
Jun 01 06:21:04.805620 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f31d33c4-1bda-472b-99ab-fba9632a2f29 req-60723e23-8db3-4c83-bc61-4b4ed9cb7491 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/security-groups?id=23991ca1-e8b0-4439-8006-3ce171b2642b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0429251
Jun 01 06:21:05.189246 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device b9282008-074c-414a-9a07-9a49782d2a84 up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:21:05.260795 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning for port b9282008-074c-414a-9a07-9a49782d2a84 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:21:05.266089 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port b9282008-074c-414a-9a07-9a49782d2a84 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:21:05.266503 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:05.391195 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:05.418760 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '31268529-11c5-4481-a0db-bbace95bfe27', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b9282008-074c-414a-9a07-9a49782d2a84'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:21:05.421169 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d4216691-964c-4a58-bbd5-cef9d77cebee" -d '{"events": [{"server_uuid": "31268529-11c5-4481-a0db-bbace95bfe27", "name": "network-vif-plugged", "status": "completed", "tag": "b9282008-074c-414a-9a07-9a49782d2a84"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:21:05.429478 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port b9282008-074c-414a-9a07-9a49782d2a84, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=b9282008-074c-414a-9a07-9a49782d2a84,segment=NetworkSegment(8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e),segment_id=8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:21:05.434632 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:05.436539 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:21:05.470730 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:21:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-34963526-1fd3-4487-a274-4deff1efe0ab x-openstack-request-id: req-34963526-1fd3-4487-a274-4deff1efe0ab {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:21:05.471020 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "31268529-11c5-4481-a0db-bbace95bfe27", "name": "network-vif-plugged", "status": "completed", "tag": "b9282008-074c-414a-9a07-9a49782d2a84", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:21:05.471276 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-34963526-1fd3-4487-a274-4deff1efe0ab {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:21:05.471662 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '31268529-11c5-4481-a0db-bbace95bfe27', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b9282008-074c-414a-9a07-9a49782d2a84', 'code': 200}
Jun 01 06:21:05.507115 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=b9282008-074c-414a-9a07-9a49782d2a84,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:21:05.509962 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:21:05.693582 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce28d757-862c-423b-8435-b0b6c26e7d80 req-6c518381-e014-4ba4-bde8-060d489b2db6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:05.694950 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ce28d757-862c-423b-8435-b0b6c26e7d80 req-6c518381-e014-4ba4-bde8-060d489b2db6 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=31268529-11c5-4481-a0db-bbace95bfe27 HTTP/1.1" status: 200  len: 1099 time: 0.0707607
Jun 01 06:21:05.735739 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ce28d757-862c-423b-8435-b0b6c26e7d80 req-8ec5015c-586d-49de-8b51-dc0a9f1447d5 service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=23991ca1-e8b0-4439-8006-3ce171b2642b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0338984
Jun 01 06:21:05.996487 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-114c3257-e35f-494f-bdec-87fba591b3b0 req-e31c8403-2dbd-49fe-b775-708cb0658f9a tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:05.997922 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-114c3257-e35f-494f-bdec-87fba591b3b0 req-e31c8403-2dbd-49fe-b775-708cb0658f9a tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=31268529-11c5-4481-a0db-bbace95bfe27 HTTP/1.1" status: 200  len: 946 time: 0.0842655
Jun 01 06:21:06.043627 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-114c3257-e35f-494f-bdec-87fba591b3b0 req-1aaa1d0d-5489-4cb3-acdd-be2b6bd494f0 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/security-groups?id=23991ca1-e8b0-4439-8006-3ce171b2642b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400658
Jun 01 06:21:07.225992 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc1d540c-9a49-4b69-bfbf-6acc24e01f00 req-94560859-f48e-44cf-8dea-37e26ee6d8fc tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:07.227434 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bc1d540c-9a49-4b69-bfbf-6acc24e01f00 req-94560859-f48e-44cf-8dea-37e26ee6d8fc tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=31268529-11c5-4481-a0db-bbace95bfe27 HTTP/1.1" status: 200  len: 946 time: 0.0791614
Jun 01 06:21:07.272241 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bc1d540c-9a49-4b69-bfbf-6acc24e01f00 req-1c9f9901-4da6-4461-9a04-4c61cc8eee38 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/security-groups?id=23991ca1-e8b0-4439-8006-3ce171b2642b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0382710
Jun 01 06:21:08.336691 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-f0eff670-20fe-4972-9a88-d472bcaf1a44 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:11.242826 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:12.349753 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-47f8130a-e495-4832-bcbb-3c755e828500 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:13.292473 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:13.615079 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 41810) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:21:13.885242 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-1087ec83-5cb7-4b76-802a-5f2718b3f3b1 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Deleting port 08ccd18d-4e8e-40b0-885e-a163bb4f9e16 {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:21:13.885483 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1087ec83-5cb7-4b76-802a-5f2718b3f3b1 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:14.005402 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1087ec83-5cb7-4b76-802a-5f2718b3f3b1 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:14.005720 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1087ec83-5cb7-4b76-802a-5f2718b3f3b1 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:14.160465 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-1087ec83-5cb7-4b76-802a-5f2718b3f3b1 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Calling delete_port for 08ccd18d-4e8e-40b0-885e-a163bb4f9e16 owned by network:floatingip {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:21:14.300401 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1087ec83-5cb7-4b76-802a-5f2718b3f3b1 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:14.304319 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-050e0400-a08a-45a9-9085-bdd3b63075b8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:21:14.356236 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1087ec83-5cb7-4b76-802a-5f2718b3f3b1 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Pushing event deleted for resources: {'Port': ['ID=08ccd18d-4e8e-40b0-885e-a163bb4f9e16,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:21:14.359050 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-1087ec83-5cb7-4b76-802a-5f2718b3f3b1 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:21:14.451606 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1087ec83-5cb7-4b76-802a-5f2718b3f3b1 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for floatingip, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:14.451960 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.db.l3_db [None req-1087ec83-5cb7-4b76-802a-5f2718b3f3b1 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Floating IP 38fc97e4-d1c2-4c92-a32d-6962e82b5c2d disassociated (deleted). External IP: 172.27.2.107, port: 5fa581a1-474d-4dc6-a414-36e7324b8555.
Jun 01 06:21:14.917272 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1087ec83-5cb7-4b76-802a-5f2718b3f3b1 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Router 00ab7a71-e7f7-4524-99c9-7562f23905d1 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92230) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:21:15.102566 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1087ec83-5cb7-4b76-802a-5f2718b3f3b1 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:21:15.113596 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2035d4b-1198-4604-bbfa-d8806b829d76 None None] Sync routers for ids ['00ab7a71-e7f7-4524-99c9-7562f23905d1'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:21:15.123049 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2035d4b-1198-4604-bbfa-d8806b829d76 None None] Routers {'00ab7a71-e7f7-4524-99c9-7562f23905d1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:21:15.123765 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-c2035d4b-1198-4604-bbfa-d8806b829d76 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2360910>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:21:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['00ab7a71-e7f7-4524-99c9-7562f23905d1'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:21:15.131370 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-1087ec83-5cb7-4b76-802a-5f2718b3f3b1 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for floatingip, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:15.193211 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-1087ec83-5cb7-4b76-802a-5f2718b3f3b1 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "DELETE /v2.0/floatingips/38fc97e4-d1c2-4c92-a32d-6962e82b5c2d HTTP/1.1" status: 204  len: 168 time: 1.5769334
Jun 01 06:21:15.194098 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'af5f753c-f6ea-450a-ac47-3802c6b16eb3', 'tag': '5fa581a1-474d-4dc6-a414-36e7324b8555'}] {{(pid=92230) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:21:15.196521 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a8971187fdc179bafebfda031591b22633150c3ea1d9449252a7819502f19756" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0d2e4fa8-0c98-4ebc-8304-b5137ed5a97a" -d '{"events": [{"name": "network-changed", "server_uuid": "af5f753c-f6ea-450a-ac47-3802c6b16eb3", "tag": "5fa581a1-474d-4dc6-a414-36e7324b8555"}]}' {{(pid=92230) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:21:15.243579 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:21:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1894eba6-8499-40ca-b834-79709f5837db x-openstack-request-id: req-1894eba6-8499-40ca-b834-79709f5837db {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:21:15.244064 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "af5f753c-f6ea-450a-ac47-3802c6b16eb3", "tag": "5fa581a1-474d-4dc6-a414-36e7324b8555", "status": "completed", "code": 200}]} {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:21:15.244578 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-1894eba6-8499-40ca-b834-79709f5837db {{(pid=92230) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:21:15.245127 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'af5f753c-f6ea-450a-ac47-3802c6b16eb3', 'tag': '5fa581a1-474d-4dc6-a414-36e7324b8555', 'status': 'completed', 'code': 200}
Jun 01 06:21:15.319618 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-c2035d4b-1198-4604-bbfa-d8806b829d76 None None] Set router 00ab7a71-e7f7-4524-99c9-7562f23905d1 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:21:15.348781 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d2e4fa8-0c98-4ebc-8304-b5137ed5a97a req-2838625c-8eb7-4436-9613-28e13e28911f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:15.350336 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0d2e4fa8-0c98-4ebc-8304-b5137ed5a97a req-2838625c-8eb7-4436-9613-28e13e28911f service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=e8bcff3fed924886a68a8562a9f4f8f3&device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 1098 time: 0.0817928
Jun 01 06:21:15.525732 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d2e4fa8-0c98-4ebc-8304-b5137ed5a97a req-10216bed-7dd6-4467-9fa9-bd2420f11cf2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:15.527616 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0d2e4fa8-0c98-4ebc-8304-b5137ed5a97a req-10216bed-7dd6-4467-9fa9-bd2420f11cf2 service neutron] 10.222.0.48 "GET /v2.0/networks?id=028fef0a-f05a-48d5-ba5c-b539846209ba HTTP/1.1" status: 200  len: 912 time: 0.1706543
Jun 01 06:21:15.529686 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:15.642118 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0d2e4fa8-0c98-4ebc-8304-b5137ed5a97a req-59ed95c3-65e7-4264-835a-820215b8352e service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=5fa581a1-474d-4dc6-a414-36e7324b8555 HTTP/1.1" status: 200  len: 217 time: 0.1070712
Jun 01 06:21:15.723358 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d2e4fa8-0c98-4ebc-8304-b5137ed5a97a req-09e31fe8-6293-4d8a-ba89-79533a927b38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:15.724725 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0d2e4fa8-0c98-4ebc-8304-b5137ed5a97a req-09e31fe8-6293-4d8a-ba89-79533a927b38 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=cdffe000-7f35-495d-a741-b4c48a060887 HTTP/1.1" status: 200  len: 850 time: 0.0739250
Jun 01 06:21:15.760177 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-c2035d4b-1198-4604-bbfa-d8806b829d76 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2360910>, [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '4292dbbd-2970-492d-a5df-e73465d512a2', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'floating_ip_address': '172.27.2.125', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'port_id': '5ba208bf-2519-4a15-b4f5-8246cedadc63', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 582, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'mac_address': 'fa:16:3e:bd:39:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3152e52-efff-440c-a60c-0c4b931f7132', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:17:34Z', 'updated_at': '2021-06-01T06:17:39Z', 'revision_number': 1, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cd6dda6e-46d3-4412-9652-c686f5fad712', 'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'mac_address': 'fa:16:3e:aa:f2:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:24Z', 'updated_at': '2021-06-01T06:13:41Z', 'revision_number': 5, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'subnets': [{'id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:21:15.764242 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2035d4b-1198-4604-bbfa-d8806b829d76 None None] Checking router: 00ab7a71-e7f7-4524-99c9-7562f23905d1 for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:21:15.773035 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2035d4b-1198-4604-bbfa-d8806b829d76 None None] Routers {'00ab7a71-e7f7-4524-99c9-7562f23905d1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:21:15.773641 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-c2035d4b-1198-4604-bbfa-d8806b829d76 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2360910>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:21:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['00ab7a71-e7f7-4524-99c9-7562f23905d1'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:21:15.778544 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17db51e0-ea81-438b-8077-3690fb9d1fd2 req-c2aeb2c4-c0ab-4037-989c-a8897b08dfcc tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:15.780865 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-17db51e0-ea81-438b-8077-3690fb9d1fd2 req-c2aeb2c4-c0ab-4037-989c-a8897b08dfcc tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 945 time: 0.1861668
Jun 01 06:21:15.842124 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-17db51e0-ea81-438b-8077-3690fb9d1fd2 req-591ee310-b357-45fb-b6a5-649b0563898e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0528326
Jun 01 06:21:15.853565 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d2e4fa8-0c98-4ebc-8304-b5137ed5a97a req-a0e56325-ad47-4a63-a304-ac8ee4ddc0e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:15.855535 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0d2e4fa8-0c98-4ebc-8304-b5137ed5a97a req-a0e56325-ad47-4a63-a304-ac8ee4ddc0e3 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=028fef0a-f05a-48d5-ba5c-b539846209ba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1224244
Jun 01 06:21:15.960329 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-c2035d4b-1198-4604-bbfa-d8806b829d76 None None] Set router 00ab7a71-e7f7-4524-99c9-7562f23905d1 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:21:15.994467 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0d2e4fa8-0c98-4ebc-8304-b5137ed5a97a req-dde2ebc8-c0c6-4c30-a029-b5531c7c7d21 service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1317127
Jun 01 06:21:16.123596 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:16.246084 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-0d2e4fa8-0c98-4ebc-8304-b5137ed5a97a req-b87351f3-a890-48cd-893c-d0f57823e22a service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2384126
Jun 01 06:21:16.345632 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-c2035d4b-1198-4604-bbfa-d8806b829d76 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2360910>, [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '4292dbbd-2970-492d-a5df-e73465d512a2', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'floating_ip_address': '172.27.2.125', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'port_id': '5ba208bf-2519-4a15-b4f5-8246cedadc63', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 582, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'mac_address': 'fa:16:3e:bd:39:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3152e52-efff-440c-a60c-0c4b931f7132', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:17:34Z', 'updated_at': '2021-06-01T06:17:39Z', 'revision_number': 1, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cd6dda6e-46d3-4412-9652-c686f5fad712', 'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'mac_address': 'fa:16:3e:aa:f2:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:24Z', 'updated_at': '2021-06-01T06:13:41Z', 'revision_number': 5, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'subnets': [{'id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:21:16.349823 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2035d4b-1198-4604-bbfa-d8806b829d76 None None] The sync data for ids ['00ab7a71-e7f7-4524-99c9-7562f23905d1'] in dv-cinder-793885-1-iscsi is: [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_floatingips': [{'id': '4292dbbd-2970-492d-a5df-e73465d512a2', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'floating_ip_address': '172.27.2.125', 'floating_network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'router_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'port_id': '5ba208bf-2519-4a15-b4f5-8246cedadc63', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'standard_attr_id': 582, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'mac_address': 'fa:16:3e:bd:39:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3152e52-efff-440c-a60c-0c4b931f7132', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T06:17:34Z', 'updated_at': '2021-06-01T06:17:39Z', 'revision_number': 1, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cd6dda6e-46d3-4412-9652-c686f5fad712', 'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'mac_address': 'fa:16:3e:aa:f2:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:24Z', 'updated_at': '2021-06-01T06:13:41Z', 'revision_number': 5, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'subnets': [{'id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:21:16.558549 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-325f752c-7e5a-4252-88c4-a0b110c1ccf1 None None] New status for floating IP 38fc97e4-d1c2-4c92-a32d-6962e82b5c2d: DOWN {{(pid=92232) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 06:21:17.049287 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1afa55d3-8b90-4179-81ef-4cf695eae6d0 req-f751e987-a975-4d79-a24d-5ad60c31a0f2 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:17.050761 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1afa55d3-8b90-4179-81ef-4cf695eae6d0 req-f751e987-a975-4d79-a24d-5ad60c31a0f2 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 945 time: 0.0906754
Jun 01 06:21:17.102080 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1afa55d3-8b90-4179-81ef-4cf695eae6d0 req-4b728f35-9f52-484c-aa4c-4ed107448e51 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0455120
Jun 01 06:21:17.244051 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2f209aa-bbf4-459b-b9ae-9795f2d5b08c req-9b2b5466-637a-4670-9b98-da76eba96571 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:17.245466 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f2f209aa-bbf4-459b-b9ae-9795f2d5b08c req-9b2b5466-637a-4670-9b98-da76eba96571 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.48 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 945 time: 0.0837326
Jun 01 06:21:17.395453 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-f2f209aa-bbf4-459b-b9ae-9795f2d5b08c req-7e86f32a-7296-4d40-be9e-cc6844479838 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Deleting port 5fa581a1-474d-4dc6-a414-36e7324b8555 {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:21:17.395808 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-f2f209aa-bbf4-459b-b9ae-9795f2d5b08c req-7e86f32a-7296-4d40-be9e-cc6844479838 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:17.536501 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-f2f209aa-bbf4-459b-b9ae-9795f2d5b08c req-7e86f32a-7296-4d40-be9e-cc6844479838 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] For port 5fa581a1-474d-4dc6-a414-36e7324b8555, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=5fa581a1-474d-4dc6-a414-36e7324b8555,segment=NetworkSegment(e9a368be-e119-4f56-bdcc-b9d10543e0d8),segment_id=e9a368be-e119-4f56-bdcc-b9d10543e0d8)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:21:17.536865 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-f2f209aa-bbf4-459b-b9ae-9795f2d5b08c req-7e86f32a-7296-4d40-be9e-cc6844479838 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:17.670105 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-f2f209aa-bbf4-459b-b9ae-9795f2d5b08c req-7e86f32a-7296-4d40-be9e-cc6844479838 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Calling delete_port for 5fa581a1-474d-4dc6-a414-36e7324b8555 owned by compute:nova {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:21:17.789065 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-f2f209aa-bbf4-459b-b9ae-9795f2d5b08c req-7e86f32a-7296-4d40-be9e-cc6844479838 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:17.795542 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-2f3a861d-a294-4473-9031-74e4ff0cd350 tempest-TestMinimumBasicScenario-1763401788 tempest-TestMinimumBasicScenario-1763401788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:21:17.841354 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e86f32a-7296-4d40-be9e-cc6844479838 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Pushing event deleted for resources: {'Port': ['ID=5fa581a1-474d-4dc6-a414-36e7324b8555,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:21:17.843933 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-7e86f32a-7296-4d40-be9e-cc6844479838 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:21:17.923347 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-f2f209aa-bbf4-459b-b9ae-9795f2d5b08c req-7e86f32a-7296-4d40-be9e-cc6844479838 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] No DVR routers for this DVR port 5fa581a1-474d-4dc6-a414-36e7324b8555 on host hv-cinder-79388 {{(pid=92229) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:21:17.925937 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-f2f209aa-bbf4-459b-b9ae-9795f2d5b08c req-7e86f32a-7296-4d40-be9e-cc6844479838 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:17.928809 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'af5f753c-f6ea-450a-ac47-3802c6b16eb3', 'name': 'network-vif-deleted', 'tag': '5fa581a1-474d-4dc6-a414-36e7324b8555'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:21:17.931101 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e376095f-79df-4d87-8b40-118197bb89f0" -d '{"events": [{"server_uuid": "af5f753c-f6ea-450a-ac47-3802c6b16eb3", "name": "network-vif-deleted", "tag": "5fa581a1-474d-4dc6-a414-36e7324b8555"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:21:17.941255 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-f2f209aa-bbf4-459b-b9ae-9795f2d5b08c req-7e86f32a-7296-4d40-be9e-cc6844479838 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.48 "DELETE /v2.0/ports/5fa581a1-474d-4dc6-a414-36e7324b8555 HTTP/1.1" status: 204  len: 173 time: 0.6868646
Jun 01 06:21:17.980218 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:21:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b0c0ba30-af64-482b-a4be-de06db9d2196 x-openstack-request-id: req-b0c0ba30-af64-482b-a4be-de06db9d2196 {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:21:17.980574 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "af5f753c-f6ea-450a-ac47-3802c6b16eb3", "name": "network-vif-deleted", "tag": "5fa581a1-474d-4dc6-a414-36e7324b8555", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:21:17.980892 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-b0c0ba30-af64-482b-a4be-de06db9d2196 {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:21:17.981326 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'af5f753c-f6ea-450a-ac47-3802c6b16eb3', 'name': 'network-vif-deleted', 'tag': '5fa581a1-474d-4dc6-a414-36e7324b8555', 'status': 'completed', 'code': 200}
Jun 01 06:21:18.249976 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-442d9746-48ba-4fd7-81af-13e7db5254e1 req-a16076b2-63ce-4045-b0a6-9e09bbd7e223 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Synchronizing usage tracker for tenant:e8bcff3fed924886a68a8562a9f4f8f3 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:21:18.268069 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-442d9746-48ba-4fd7-81af-13e7db5254e1 req-a16076b2-63ce-4045-b0a6-9e09bbd7e223 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Unset dirty status for tenant:e8bcff3fed924886a68a8562a9f4f8f3 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:21:18.269506 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-442d9746-48ba-4fd7-81af-13e7db5254e1 req-a16076b2-63ce-4045-b0a6-9e09bbd7e223 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=af5f753c-f6ea-450a-ac47-3802c6b16eb3 HTTP/1.1" status: 200  len: 210 time: 0.0614755
Jun 01 06:21:19.251481 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 5fa581a1-474d-4dc6-a414-36e7324b8555 no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:21:19.288632 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] No Port match for: 5fa581a1-474d-4dc6-a414-36e7324b8555 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:21:19.288977 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 5fa581a1-474d-4dc6-a414-36e7324b8555 not bound to the agent host hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:21:21.723806 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:21:21.791633 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 41866) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:21:22.060821 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Deleting port 47d251d3-f820-4ad3-a503-423d3e33b6ed {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:21:22.061159 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:22.179072 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:22.179389 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:22.300450 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Calling delete_port for 47d251d3-f820-4ad3-a503-423d3e33b6ed owned by network:floatingip {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:21:22.424442 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:22.428315 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-398df4ed-5652-4f03-94cb-8d789cb3a7ee tempest-AttachVolumeTestJSON-1215957675 tempest-AttachVolumeTestJSON-1215957675-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:21:22.476826 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Pushing event deleted for resources: {'Port': ['ID=47d251d3-f820-4ad3-a503-423d3e33b6ed,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:21:22.548324 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:22.548705 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:22.549075 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:22.549437 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:22.549794 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:22.550154 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:22.550512 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:22.550874 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:22.551230 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:22.551582 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:22.551959 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:22.552313 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:22.555557 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:21:22.587002 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for floatingip, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:22.587334 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.db.l3_db [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Floating IP 4292dbbd-2970-492d-a5df-e73465d512a2 disassociated (deleted). External IP: 172.27.2.125, port: 5ba208bf-2519-4a15-b4f5-8246cedadc63.
Jun 01 06:21:23.078981 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Router 00ab7a71-e7f7-4524-99c9-7562f23905d1 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92230) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:21:23.283638 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:21:23.295479 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e2c74d3-8a28-4f7c-8227-da9f4ac861b1 None None] Sync routers for ids ['00ab7a71-e7f7-4524-99c9-7562f23905d1'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:21:23.306880 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e2c74d3-8a28-4f7c-8227-da9f4ac861b1 None None] Routers {'00ab7a71-e7f7-4524-99c9-7562f23905d1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:21:23.307521 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-1e2c74d3-8a28-4f7c-8227-da9f4ac861b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2178a60>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:21:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['00ab7a71-e7f7-4524-99c9-7562f23905d1'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:21:23.310317 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for floatingip, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:23.374011 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "DELETE /v2.0/floatingips/4292dbbd-2970-492d-a5df-e73465d512a2 HTTP/1.1" status: 204  len: 168 time: 1.5782883
Jun 01 06:21:23.374011 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c3152e52-efff-440c-a60c-0c4b931f7132', 'tag': '5ba208bf-2519-4a15-b4f5-8246cedadc63'}] {{(pid=92230) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:21:23.374965 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a8971187fdc179bafebfda031591b22633150c3ea1d9449252a7819502f19756" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3d3ec739-197a-426e-bc15-1f5353bbf9b2" -d '{"events": [{"name": "network-changed", "server_uuid": "c3152e52-efff-440c-a60c-0c4b931f7132", "tag": "5ba208bf-2519-4a15-b4f5-8246cedadc63"}]}' {{(pid=92230) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:21:23.509315 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-1e2c74d3-8a28-4f7c-8227-da9f4ac861b1 None None] Set router 00ab7a71-e7f7-4524-99c9-7562f23905d1 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:21:23.640829 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:21:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-45e9dfda-e8d3-4876-9a39-6cc459b30cc1 x-openstack-request-id: req-45e9dfda-e8d3-4876-9a39-6cc459b30cc1 {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:21:23.641517 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c3152e52-efff-440c-a60c-0c4b931f7132", "tag": "5ba208bf-2519-4a15-b4f5-8246cedadc63", "status": "completed", "code": 200}]} {{(pid=92230) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:21:23.642032 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-45e9dfda-e8d3-4876-9a39-6cc459b30cc1 {{(pid=92230) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:21:23.642714 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c3152e52-efff-440c-a60c-0c4b931f7132', 'tag': '5ba208bf-2519-4a15-b4f5-8246cedadc63', 'status': 'completed', 'code': 200}
Jun 01 06:21:23.818311 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d3ec739-197a-426e-bc15-1f5353bbf9b2 req-a5a5564e-e763-4b5b-a07e-494335fd97a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:23.821275 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3d3ec739-197a-426e-bc15-1f5353bbf9b2 req-a5a5564e-e763-4b5b-a07e-494335fd97a9 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=e8bcff3fed924886a68a8562a9f4f8f3&device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 1098 time: 0.1459203
Jun 01 06:21:23.883135 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-1e2c74d3-8a28-4f7c-8227-da9f4ac861b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2178a60>, [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': 'cd6dda6e-46d3-4412-9652-c686f5fad712', 'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'mac_address': 'fa:16:3e:aa:f2:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:24Z', 'updated_at': '2021-06-01T06:13:41Z', 'revision_number': 5, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'subnets': [{'id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:21:23.889737 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e2c74d3-8a28-4f7c-8227-da9f4ac861b1 None None] Checking router: 00ab7a71-e7f7-4524-99c9-7562f23905d1 for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:21:23.910626 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e2c74d3-8a28-4f7c-8227-da9f4ac861b1 None None] Routers {'00ab7a71-e7f7-4524-99c9-7562f23905d1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:21:23.911363 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-1e2c74d3-8a28-4f7c-8227-da9f4ac861b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b2178a60>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:21:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['00ab7a71-e7f7-4524-99c9-7562f23905d1'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:21:24.033827 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d3ec739-197a-426e-bc15-1f5353bbf9b2 req-70e773c7-bda4-4481-88ff-eaf1049be56d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:24.035293 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3d3ec739-197a-426e-bc15-1f5353bbf9b2 req-70e773c7-bda4-4481-88ff-eaf1049be56d service neutron] 10.222.0.48 "GET /v2.0/networks?id=028fef0a-f05a-48d5-ba5c-b539846209ba HTTP/1.1" status: 200  len: 912 time: 0.2055159
Jun 01 06:21:24.098955 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3026d00-244a-476c-9af0-6c14a6503902 req-58bfbaff-87fe-4880-82f5-386887c230cc tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:24.100436 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c3026d00-244a-476c-9af0-6c14a6503902 req-58bfbaff-87fe-4880-82f5-386887c230cc tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 945 time: 0.3624465
Jun 01 06:21:24.132191 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3d3ec739-197a-426e-bc15-1f5353bbf9b2 req-f1f4c224-f941-4df8-ab10-e4cb123ad98a service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=5ba208bf-2519-4a15-b4f5-8246cedadc63 HTTP/1.1" status: 200  len: 217 time: 0.0891387
Jun 01 06:21:24.143384 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-1e2c74d3-8a28-4f7c-8227-da9f4ac861b1 None None] Set router 00ab7a71-e7f7-4524-99c9-7562f23905d1 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:21:24.213539 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-c3026d00-244a-476c-9af0-6c14a6503902 req-699b6de5-d6c6-4f4a-a9d5-de2651f7b7ff tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1055517
Jun 01 06:21:24.219756 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d3ec739-197a-426e-bc15-1f5353bbf9b2 req-abbd95f4-7a3e-4786-9e32-7a525e51ef4e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:24.220859 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3d3ec739-197a-426e-bc15-1f5353bbf9b2 req-abbd95f4-7a3e-4786-9e32-7a525e51ef4e service neutron] 10.222.0.48 "GET /v2.0/subnets?id=cdffe000-7f35-495d-a741-b4c48a060887 HTTP/1.1" status: 200  len: 850 time: 0.0811782
Jun 01 06:21:24.308329 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d3ec739-197a-426e-bc15-1f5353bbf9b2 req-10a17988-8ced-4ed9-bc9c-377430181fd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:24.310008 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3d3ec739-197a-426e-bc15-1f5353bbf9b2 req-10a17988-8ced-4ed9-bc9c-377430181fd7 service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=028fef0a-f05a-48d5-ba5c-b539846209ba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0773966
Jun 01 06:21:24.450474 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3d3ec739-197a-426e-bc15-1f5353bbf9b2 req-c072aced-cc97-422d-ba3b-5e5004fc5165 service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1333005
Jun 01 06:21:24.483739 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-1e2c74d3-8a28-4f7c-8227-da9f4ac861b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b2178a60>, [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': 'cd6dda6e-46d3-4412-9652-c686f5fad712', 'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'mac_address': 'fa:16:3e:aa:f2:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:24Z', 'updated_at': '2021-06-01T06:13:41Z', 'revision_number': 5, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'subnets': [{'id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:21:24.488379 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e2c74d3-8a28-4f7c-8227-da9f4ac861b1 None None] The sync data for ids ['00ab7a71-e7f7-4524-99c9-7562f23905d1'] in dv-cinder-793885-1-iscsi is: [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:13:25Z', 'revision_number': 4, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi', '_interfaces': [{'id': 'cd6dda6e-46d3-4412-9652-c686f5fad712', 'name': '', 'network_id': '028fef0a-f05a-48d5-ba5c-b539846209ba', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'mac_address': 'fa:16:3e:aa:f2:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_interface', 'standard_attr_id': 344, 'fixed_ips': [{'subnet_id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:24Z', 'updated_at': '2021-06-01T06:13:41Z', 'revision_number': 5, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'subnets': [{'id': 'cdffe000-7f35-495d-a741-b4c48a060887', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:21:24.702549 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-3d3ec739-197a-426e-bc15-1f5353bbf9b2 req-56bda847-4d0f-403d-90cb-30a332671ab7 service neutron] 10.222.0.48 "GET /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2446342
Jun 01 06:21:24.713046 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5874f18a-eae8-4c58-b126-8c06640791f0 None None] New status for floating IP 4292dbbd-2970-492d-a5df-e73465d512a2: DOWN {{(pid=92232) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 06:21:25.235231 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d407963-4b1a-48d1-9b62-c39f5bb33619 req-e55c61d2-4784-4553-87af-9c341b0ac5cd tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:25.236689 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5d407963-4b1a-48d1-9b62-c39f5bb33619 req-e55c61d2-4784-4553-87af-9c341b0ac5cd tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.48 "GET /v2.0/ports?device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 945 time: 0.0799558
Jun 01 06:21:25.432275 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-5d407963-4b1a-48d1-9b62-c39f5bb33619 req-bb2face1-6a5f-49e0-9fc3-36a06c9ebb88 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Deleting port 5ba208bf-2519-4a15-b4f5-8246cedadc63 {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:21:25.432600 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-5d407963-4b1a-48d1-9b62-c39f5bb33619 req-bb2face1-6a5f-49e0-9fc3-36a06c9ebb88 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:25.603525 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70ec7173-3298-4522-88c4-a270c16f4be8 req-768b3605-2573-486e-8553-dc0a79fdc6e6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:25.604979 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-70ec7173-3298-4522-88c4-a270c16f4be8 req-768b3605-2573-486e-8553-dc0a79fdc6e6 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 945 time: 0.2660897
Jun 01 06:21:25.607401 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-5d407963-4b1a-48d1-9b62-c39f5bb33619 req-bb2face1-6a5f-49e0-9fc3-36a06c9ebb88 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] For port 5ba208bf-2519-4a15-b4f5-8246cedadc63, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=5ba208bf-2519-4a15-b4f5-8246cedadc63,segment=NetworkSegment(e9a368be-e119-4f56-bdcc-b9d10543e0d8),segment_id=e9a368be-e119-4f56-bdcc-b9d10543e0d8)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:21:25.607751 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-5d407963-4b1a-48d1-9b62-c39f5bb33619 req-bb2face1-6a5f-49e0-9fc3-36a06c9ebb88 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:25.745765 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-5d407963-4b1a-48d1-9b62-c39f5bb33619 req-bb2face1-6a5f-49e0-9fc3-36a06c9ebb88 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Calling delete_port for 5ba208bf-2519-4a15-b4f5-8246cedadc63 owned by compute:nova {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:21:25.772662 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-70ec7173-3298-4522-88c4-a270c16f4be8 req-37b64190-20b1-4412-9be2-df4207de97d2 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/security-groups?id=837b69a3-6811-4cdc-8ade-9ad4352f4196&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1575348
Jun 01 06:21:25.878096 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-5d407963-4b1a-48d1-9b62-c39f5bb33619 req-bb2face1-6a5f-49e0-9fc3-36a06c9ebb88 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:25.884013 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:21:25.934141 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb2face1-6a5f-49e0-9fc3-36a06c9ebb88 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Pushing event deleted for resources: {'Port': ['ID=5ba208bf-2519-4a15-b4f5-8246cedadc63,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:21:25.937832 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-bb2face1-6a5f-49e0-9fc3-36a06c9ebb88 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:21:26.016241 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-5d407963-4b1a-48d1-9b62-c39f5bb33619 req-bb2face1-6a5f-49e0-9fc3-36a06c9ebb88 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] No DVR routers for this DVR port 5ba208bf-2519-4a15-b4f5-8246cedadc63 on host hv-cinder-79388 {{(pid=92229) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:21:26.019358 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-5d407963-4b1a-48d1-9b62-c39f5bb33619 req-bb2face1-6a5f-49e0-9fc3-36a06c9ebb88 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:26.022139 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c3152e52-efff-440c-a60c-0c4b931f7132', 'name': 'network-vif-deleted', 'tag': '5ba208bf-2519-4a15-b4f5-8246cedadc63'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:21:26.024591 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5fa7b393-769a-48d6-a70d-078b22cb8638" -d '{"events": [{"server_uuid": "c3152e52-efff-440c-a60c-0c4b931f7132", "name": "network-vif-deleted", "tag": "5ba208bf-2519-4a15-b4f5-8246cedadc63"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:21:26.036397 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-5d407963-4b1a-48d1-9b62-c39f5bb33619 req-bb2face1-6a5f-49e0-9fc3-36a06c9ebb88 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.48 "DELETE /v2.0/ports/5ba208bf-2519-4a15-b4f5-8246cedadc63 HTTP/1.1" status: 204  len: 173 time: 0.7943485
Jun 01 06:21:26.069891 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:21:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-44ade179-19a0-42e0-83c6-aac646fbf4f2 x-openstack-request-id: req-44ade179-19a0-42e0-83c6-aac646fbf4f2 {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:21:26.070191 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c3152e52-efff-440c-a60c-0c4b931f7132", "name": "network-vif-deleted", "tag": "5ba208bf-2519-4a15-b4f5-8246cedadc63", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:21:26.070484 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-44ade179-19a0-42e0-83c6-aac646fbf4f2 {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:21:26.071056 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c3152e52-efff-440c-a60c-0c4b931f7132', 'name': 'network-vif-deleted', 'tag': '5ba208bf-2519-4a15-b4f5-8246cedadc63', 'status': 'completed', 'code': 200}
Jun 01 06:21:26.954780 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-937b3474-0f65-40fd-ae00-b2db6477722a req-75bdea44-9dc2-4551-a4c2-650c9b3ddf23 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Synchronizing usage tracker for tenant:e8bcff3fed924886a68a8562a9f4f8f3 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:21:26.972489 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-937b3474-0f65-40fd-ae00-b2db6477722a req-75bdea44-9dc2-4551-a4c2-650c9b3ddf23 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Unset dirty status for tenant:e8bcff3fed924886a68a8562a9f4f8f3 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:21:26.973647 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-937b3474-0f65-40fd-ae00-b2db6477722a req-75bdea44-9dc2-4551-a4c2-650c9b3ddf23 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "GET /v2.0/ports?device_id=c3152e52-efff-440c-a60c-0c4b931f7132 HTTP/1.1" status: 200  len: 210 time: 0.0658364
Jun 01 06:21:27.282705 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 5ba208bf-2519-4a15-b4f5-8246cedadc63 no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:21:27.318102 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] No Port match for: 5ba208bf-2519-4a15-b4f5-8246cedadc63 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:21:27.318452 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 5ba208bf-2519-4a15-b4f5-8246cedadc63 not bound to the agent host hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:21:28.070164 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 41910) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:21:28.287269 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-2f22ba0e-8d84-42a6-80a6-d6f32012e58e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Deleting port 37de0740-52ba-482e-9948-f00d6e45d2a3 {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:21:28.287598 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2f22ba0e-8d84-42a6-80a6-d6f32012e58e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:28.405491 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2f22ba0e-8d84-42a6-80a6-d6f32012e58e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:28.405820 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2f22ba0e-8d84-42a6-80a6-d6f32012e58e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:28.533124 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-2f22ba0e-8d84-42a6-80a6-d6f32012e58e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Calling delete_port for 37de0740-52ba-482e-9948-f00d6e45d2a3 owned by network:floatingip {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:21:28.645012 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2f22ba0e-8d84-42a6-80a6-d6f32012e58e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:28.648998 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e2aff0b7-e057-43e2-910b-f95bd8995474 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:21:28.693812 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f22ba0e-8d84-42a6-80a6-d6f32012e58e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Pushing event deleted for resources: {'Port': ['ID=37de0740-52ba-482e-9948-f00d6e45d2a3,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:21:28.697314 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-2f22ba0e-8d84-42a6-80a6-d6f32012e58e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:21:28.834399 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2f22ba0e-8d84-42a6-80a6-d6f32012e58e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for floatingip, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:28.860456 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2f22ba0e-8d84-42a6-80a6-d6f32012e58e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for floatingip, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:28.861787 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-2f22ba0e-8d84-42a6-80a6-d6f32012e58e tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "DELETE /v2.0/floatingips/4c6a9e9d-ea2e-4346-a164-98d7263ff8aa HTTP/1.1" status: 204  len: 168 time: 0.7905557
Jun 01 06:21:30.257251 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 41928) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:21:30.337669 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-00b4d730-0e81-4b8e-9d56-782138750736 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:30.368726 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-00b4d730-0e81-4b8e-9d56-782138750736 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:30.438586 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-00b4d730-0e81-4b8e-9d56-782138750736 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:30.443768 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-a0f84972-3f08-4380-8b28-55728647a246 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:21:30.458692 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00b4d730-0e81-4b8e-9d56-782138750736 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=837b69a3-6811-4cdc-8ade-9ad4352f4196,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:21:30.461745 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-00b4d730-0e81-4b8e-9d56-782138750736 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:21:30.476645 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-00b4d730-0e81-4b8e-9d56-782138750736 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:30.477791 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-00b4d730-0e81-4b8e-9d56-782138750736 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] 10.222.0.25 "DELETE /v2.0/security-groups/837b69a3-6811-4cdc-8ade-9ad4352f4196 HTTP/1.1" status: 204  len: 168 time: 0.2194793
Jun 01 06:21:30.542376 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 41940) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:21:31.295684 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-439e9fb1-99d6-4c64-a961-0863af1c164d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-744138'] for router_interface, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:31.729859 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-439e9fb1-99d6-4c64-a961-0863af1c164d admin admin] Deleting port cd6dda6e-46d3-4412-9652-c686f5fad712 {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:21:31.730185 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-439e9fb1-99d6-4c64-a961-0863af1c164d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:31.861130 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [None req-439e9fb1-99d6-4c64-a961-0863af1c164d admin admin] For port cd6dda6e-46d3-4412-9652-c686f5fad712, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=cd6dda6e-46d3-4412-9652-c686f5fad712,segment=NetworkSegment(e9a368be-e119-4f56-bdcc-b9d10543e0d8),segment_id=e9a368be-e119-4f56-bdcc-b9d10543e0d8)] {{(pid=92230) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:21:31.861500 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-439e9fb1-99d6-4c64-a961-0863af1c164d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:31.988417 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-439e9fb1-99d6-4c64-a961-0863af1c164d admin admin] Calling delete_port for cd6dda6e-46d3-4412-9652-c686f5fad712 owned by network:router_interface {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:21:32.140670 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-439e9fb1-99d6-4c64-a961-0863af1c164d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:32.144308 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-617df3be-3a9f-4a9f-b09a-45a23c45e830 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:21:32.188976 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-439e9fb1-99d6-4c64-a961-0863af1c164d admin admin] Pushing event deleted for resources: {'Port': ['ID=cd6dda6e-46d3-4412-9652-c686f5fad712,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:21:32.191943 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-439e9fb1-99d6-4c64-a961-0863af1c164d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:21:32.585795 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-439e9fb1-99d6-4c64-a961-0863af1c164d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-581113', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-746586'] for router_interface, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:32.987532 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-439e9fb1-99d6-4c64-a961-0863af1c164d admin admin] Router 00ab7a71-e7f7-4524-99c9-7562f23905d1 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92230) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:21:33.176218 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-439e9fb1-99d6-4c64-a961-0863af1c164d admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:21:33.187939 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a79c972c-aef4-41d7-8c6f-63fd01480160 None None] Sync routers for ids ['00ab7a71-e7f7-4524-99c9-7562f23905d1'] in dv-cinder-793885-1-iscsi {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:21:33.194924 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-439e9fb1-99d6-4c64-a961-0863af1c164d admin admin] 10.222.0.25 "PUT /v2.0/routers/00ab7a71-e7f7-4524-99c9-7562f23905d1/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6504023
Jun 01 06:21:33.197915 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 41952) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:21:33.199158 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a79c972c-aef4-41d7-8c6f-63fd01480160 None None] Routers {'00ab7a71-e7f7-4524-99c9-7562f23905d1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:21:33.200449 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-a79c972c-aef4-41d7-8c6f-63fd01480160 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b27f1d60>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:21:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['00ab7a71-e7f7-4524-99c9-7562f23905d1'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:21:33.394064 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-514182a0-abbf-4b51-b13e-0aa8edfc0928 admin admin] Notify callbacks [] for router, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:33.401275 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-a79c972c-aef4-41d7-8c6f-63fd01480160 None None] Set router 00ab7a71-e7f7-4524-99c9-7562f23905d1 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:21:33.580518 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-514182a0-abbf-4b51-b13e-0aa8edfc0928 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:33.663235 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [None req-514182a0-abbf-4b51-b13e-0aa8edfc0928 admin admin] Deleting port 11fed125-e49d-4bbd-8888-eac8a4fe11e9 {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:21:33.663567 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-514182a0-abbf-4b51-b13e-0aa8edfc0928 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:33.703083 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-a79c972c-aef4-41d7-8c6f-63fd01480160 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b27f1d60>, [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171'}], 'enable_snat': True}, 'gw_port_id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:21:32Z', 'revision_number': 5, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port': {'id': '11fed125-e49d-4bbd-8888-eac8a4fe11e9', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:99:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 342, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:18Z', 'updated_at': '2021-06-01T06:13:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:21:33.707735 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a79c972c-aef4-41d7-8c6f-63fd01480160 None None] Checking router: 00ab7a71-e7f7-4524-99c9-7562f23905d1 for host: dv-cinder-793885-1-iscsi {{(pid=92231) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:21:33.718401 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a79c972c-aef4-41d7-8c6f-63fd01480160 None None] Routers {'00ab7a71-e7f7-4524-99c9-7562f23905d1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92231) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:21:33.719045 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-a79c972c-aef4-41d7-8c6f-63fd01480160 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b27f1d60>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:21:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['00ab7a71-e7f7-4524-99c9-7562f23905d1'], 'active': True} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:21:33.883280 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvr_db [None req-a79c972c-aef4-41d7-8c6f-63fd01480160 None None] Set router 00ab7a71-e7f7-4524-99c9-7562f23905d1 gateway port host: None {{(pid=92231) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:21:33.895283 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [None req-514182a0-abbf-4b51-b13e-0aa8edfc0928 admin admin] For port 11fed125-e49d-4bbd-8888-eac8a4fe11e9, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=11fed125-e49d-4bbd-8888-eac8a4fe11e9,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:21:33.895637 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-514182a0-abbf-4b51-b13e-0aa8edfc0928 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:33.997052 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_hamode_db [None req-a79c972c-aef4-41d7-8c6f-63fd01480160 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b27f1d60>, [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:21:33Z', 'revision_number': 6, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port_host': None}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92231) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:21:34.001867 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a79c972c-aef4-41d7-8c6f-63fd01480160 None None] The sync data for ids ['00ab7a71-e7f7-4524-99c9-7562f23905d1'] in dv-cinder-793885-1-iscsi is: [{'id': '00ab7a71-e7f7-4524-99c9-7562f23905d1', 'name': 'tempest-TestVolumeBootPattern-886353077-router', 'tenant_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:17Z', 'updated_at': '2021-06-01T06:21:33Z', 'revision_number': 6, 'project_id': 'e8bcff3fed924886a68a8562a9f4f8f3', 'gw_port_host': None}] {{(pid=92231) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:21:34.024938 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [None req-514182a0-abbf-4b51-b13e-0aa8edfc0928 admin admin] Calling delete_port for 11fed125-e49d-4bbd-8888-eac8a4fe11e9 owned by network:router_gateway {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:21:34.185141 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-514182a0-abbf-4b51-b13e-0aa8edfc0928 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:34.189312 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-91074dc6-f07c-4f7f-9731-c7aac9578dbe admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:21:34.236981 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-514182a0-abbf-4b51-b13e-0aa8edfc0928 admin admin] Pushing event deleted for resources: {'Port': ['ID=11fed125-e49d-4bbd-8888-eac8a4fe11e9,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:21:34.240077 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-514182a0-abbf-4b51-b13e-0aa8edfc0928 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:21:34.343478 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-514182a0-abbf-4b51-b13e-0aa8edfc0928 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-745687'] for router_gateway, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:34.414086 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device cd6dda6e-46d3-4412-9652-c686f5fad712 no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:21:34.455661 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: cd6dda6e-46d3-4412-9652-c686f5fad712 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:21:34.456303 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device cd6dda6e-46d3-4412-9652-c686f5fad712 not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:21:34.533411 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-514182a0-abbf-4b51-b13e-0aa8edfc0928 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-748122', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-727'] for router, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:34.535693 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-514182a0-abbf-4b51-b13e-0aa8edfc0928 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:34.623842 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-514182a0-abbf-4b51-b13e-0aa8edfc0928 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-746854'] for router, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:34.624375 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-514182a0-abbf-4b51-b13e-0aa8edfc0928 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 00ab7a71-e7f7-4524-99c9-7562f23905d1 {{(pid=92229) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 06:21:34.637120 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-514182a0-abbf-4b51-b13e-0aa8edfc0928 admin admin] Notify callbacks [] for router, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:34.639279 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-514182a0-abbf-4b51-b13e-0aa8edfc0928 admin admin] 10.222.0.25 "DELETE /v2.0/routers/00ab7a71-e7f7-4524-99c9-7562f23905d1 HTTP/1.1" status: 204  len: 168 time: 1.4403095
Jun 01 06:21:34.641929 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 41958) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:21:34.713272 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_v2 [None req-60e29231-82fa-4dcd-b35e-f71bcc2642e3 admin admin] Deleting subnet cdffe000-7f35-495d-a741-b4c48a060887 {{(pid=92229) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 06:21:34.716594 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60e29231-82fa-4dcd-b35e-f71bcc2642e3 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:34.779761 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60e29231-82fa-4dcd-b35e-f71bcc2642e3 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2127096'] for subnet, precommit_delete_associations {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:34.878241 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60e29231-82fa-4dcd-b35e-f71bcc2642e3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8086245'] for subnet, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:35.165374 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60e29231-82fa-4dcd-b35e-f71bcc2642e3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8087120', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1981457', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2134750'] for subnet, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:35.172174 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:21:35.213513 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60e29231-82fa-4dcd-b35e-f71bcc2642e3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=cdffe000-7f35-495d-a741-b4c48a060887,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:21:35.217603 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-60e29231-82fa-4dcd-b35e-f71bcc2642e3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:21:35.218660 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-60e29231-82fa-4dcd-b35e-f71bcc2642e3 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:35.225023 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c79e7c4d-e6bb-46c8-9617-d93d27c286ee None None] Network 028fef0a-f05a-48d5-ba5c-b539846209ba requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:21:35.227119 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-60e29231-82fa-4dcd-b35e-f71bcc2642e3 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/cdffe000-7f35-495d-a741-b4c48a060887 HTTP/1.1" status: 204  len: 168 time: 0.5837801
Jun 01 06:21:35.229407 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 41966) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:21:35.357740 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a73086e0-6348-4fdc-8e58-09966e6fa6ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8063377'] for network, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:35.436260 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-a73086e0-6348-4fdc-8e58-09966e6fa6ac admin admin] Deleting port aef202dd-622d-40c5-bcd0-3e6b5c08efe2 {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:21:35.436592 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a73086e0-6348-4fdc-8e58-09966e6fa6ac admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:35.540909 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [None req-a73086e0-6348-4fdc-8e58-09966e6fa6ac admin admin] For port aef202dd-622d-40c5-bcd0-3e6b5c08efe2, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=aef202dd-622d-40c5-bcd0-3e6b5c08efe2,segment=NetworkSegment(e9a368be-e119-4f56-bdcc-b9d10543e0d8),segment_id=e9a368be-e119-4f56-bdcc-b9d10543e0d8)] {{(pid=92230) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:21:35.541265 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a73086e0-6348-4fdc-8e58-09966e6fa6ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:35.544177 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f077587f-7e03-4d69-871a-4b00fc2ca63d None None] DHCP port deletion for 028fef0a-f05a-48d5-ba5c-b539846209ba request from dv-cinder-793885-1-iscsi {{(pid=92231) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 06:21:35.613194 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-f077587f-7e03-4d69-871a-4b00fc2ca63d None None] Deleting port aef202dd-622d-40c5-bcd0-3e6b5c08efe2 {{(pid=92231) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:21:35.613575 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-f077587f-7e03-4d69-871a-4b00fc2ca63d None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:35.691452 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-a73086e0-6348-4fdc-8e58-09966e6fa6ac admin admin] Calling delete_port for aef202dd-622d-40c5-bcd0-3e6b5c08efe2 owned by network:dhcp {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:21:35.719255 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-f077587f-7e03-4d69-871a-4b00fc2ca63d None None] For port aef202dd-622d-40c5-bcd0-3e6b5c08efe2, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=aef202dd-622d-40c5-bcd0-3e6b5c08efe2,segment=NetworkSegment(e9a368be-e119-4f56-bdcc-b9d10543e0d8),segment_id=e9a368be-e119-4f56-bdcc-b9d10543e0d8)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:21:35.719651 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-f077587f-7e03-4d69-871a-4b00fc2ca63d None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:35.745011 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a73086e0-6348-4fdc-8e58-09966e6fa6ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:35.750657 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-b1ee79a3-3651-4267-8db9-45d32d99f3f8 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:21:35.799003 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a73086e0-6348-4fdc-8e58-09966e6fa6ac admin admin] Pushing event deleted for resources: {'Port': ['ID=aef202dd-622d-40c5-bcd0-3e6b5c08efe2,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:21:35.803928 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-a73086e0-6348-4fdc-8e58-09966e6fa6ac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:21:35.807509 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a73086e0-6348-4fdc-8e58-09966e6fa6ac admin admin] No DVR routers for this DVR port aef202dd-622d-40c5-bcd0-3e6b5c08efe2 on host dv-cinder-793885-1-iscsi {{(pid=92230) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:21:35.848148 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-f077587f-7e03-4d69-871a-4b00fc2ca63d None None] Calling delete_port for aef202dd-622d-40c5-bcd0-3e6b5c08efe2 owned by network:dhcp {{(pid=92231) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:21:35.898172 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-f077587f-7e03-4d69-871a-4b00fc2ca63d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756'] for port, after_delete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:35.901897 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:21:35.933286 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a73086e0-6348-4fdc-8e58-09966e6fa6ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8093290', 'neutron.services.segments.db._delete_segments_for_network-8788497006300'] for network, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:35.948344 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f077587f-7e03-4d69-871a-4b00fc2ca63d None None] Pushing event deleted for resources: {'Port': ['ID=aef202dd-622d-40c5-bcd0-3e6b5c08efe2,revision_number=None']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:21:35.948864 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-a73086e0-6348-4fdc-8e58-09966e6fa6ac admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe3b1fcc5e0>,) {'filters': {'network_id': ['028fef0a-f05a-48d5-ba5c-b539846209ba']}} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:21:35.952795 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-f077587f-7e03-4d69-871a-4b00fc2ca63d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:21:35.955475 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f077587f-7e03-4d69-871a-4b00fc2ca63d None None] No DVR routers for this DVR port aef202dd-622d-40c5-bcd0-3e6b5c08efe2 on host dv-cinder-793885-1-iscsi {{(pid=92231) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:21:35.976168 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-a73086e0-6348-4fdc-8e58-09966e6fa6ac admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b1fcc5e0>, 'e9a368be-e119-4f56-bdcc-b9d10543e0d8') {'for_net_delete': True} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:21:35.976533 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-a73086e0-6348-4fdc-8e58-09966e6fa6ac admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b1fcc5e0>, 'e9a368be-e119-4f56-bdcc-b9d10543e0d8') {} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:21:35.990049 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a73086e0-6348-4fdc-8e58-09966e6fa6ac admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8788497014941', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2178892'] for segment, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:36.008150 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a73086e0-6348-4fdc-8e58-09966e6fa6ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:36.016165 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a73086e0-6348-4fdc-8e58-09966e6fa6ac admin admin] Releasing vlan 209 on physical network physnet1 to pool {{(pid=92230) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 06:21:36.016585 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a73086e0-6348-4fdc-8e58-09966e6fa6ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2416152'] for segment, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]: Traceback (most recent call last):
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:     timer()
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:     cb(*args, **kw)
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:     return func(*args, **kwargs)
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:     self._notify()
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:     self.callback(batched_events)
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:     event.method(event)
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:     return f(self, *a, **k)
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self._get(url).json()
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self.request(url, 'GET', **kwargs)
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 06:21:36.033834 dv-cinder-793885-1-iscsi neutron-server[92230]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 06:21:36.206167 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a73086e0-6348-4fdc-8e58-09966e6fa6ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8093283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-745674'] for network, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:36.209733 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:21:36.222632 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-a73086e0-6348-4fdc-8e58-09966e6fa6ac admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:36.234834 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a73086e0-6348-4fdc-8e58-09966e6fa6ac admin admin] Pushing event deleted for resources: {'Network': ['ID=028fef0a-f05a-48d5-ba5c-b539846209ba,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:21:36.238294 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-a73086e0-6348-4fdc-8e58-09966e6fa6ac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:21:36.240066 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-a73086e0-6348-4fdc-8e58-09966e6fa6ac admin admin] 10.222.0.25 "DELETE /v2.0/networks/028fef0a-f05a-48d5-ba5c-b539846209ba HTTP/1.1" status: 204  len: 168 time: 1.0096424
Jun 01 06:21:36.242863 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 41974) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:21:36.353268 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 11fed125-e49d-4bbd-8888-eac8a4fe11e9 no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:21:36.388406 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: 11fed125-e49d-4bbd-8888-eac8a4fe11e9 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:21:36.388751 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 11fed125-e49d-4bbd-8888-eac8a4fe11e9 not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:21:36.389168 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device aef202dd-622d-40c5-bcd0-3e6b5c08efe2 no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:21:36.422366 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: aef202dd-622d-40c5-bcd0-3e6b5c08efe2 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:21:36.422714 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device aef202dd-622d-40c5-bcd0-3e6b5c08efe2 not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:21:36.794901 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e83ac766-4cc1-4725-8f6a-1f0ee3a21600 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-744138'] for router_interface, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:37.212873 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-e83ac766-4cc1-4725-8f6a-1f0ee3a21600 admin admin] Deleting port 1fa94810-bdd9-40a1-be64-ad8458a57c81 {{(pid=92230) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:21:37.213206 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e83ac766-4cc1-4725-8f6a-1f0ee3a21600 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:37.344656 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.db [None req-e83ac766-4cc1-4725-8f6a-1f0ee3a21600 admin admin] For port 1fa94810-bdd9-40a1-be64-ad8458a57c81, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=1fa94810-bdd9-40a1-be64-ad8458a57c81,segment=NetworkSegment(82caaa19-2534-4a80-96d3-c3f641675978),segment_id=82caaa19-2534-4a80-96d3-c3f641675978)] {{(pid=92230) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:21:37.345344 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e83ac766-4cc1-4725-8f6a-1f0ee3a21600 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:37.469504 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.plugin [None req-e83ac766-4cc1-4725-8f6a-1f0ee3a21600 admin admin] Calling delete_port for 1fa94810-bdd9-40a1-be64-ad8458a57c81 owned by network:router_interface {{(pid=92230) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:21:37.712369 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e83ac766-4cc1-4725-8f6a-1f0ee3a21600 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2416205'] for port, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:37.717038 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-98e5b0d3-6ce9-495c-90be-8d635e810db5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:21:37.760966 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e83ac766-4cc1-4725-8f6a-1f0ee3a21600 admin admin] Pushing event deleted for resources: {'Port': ['ID=1fa94810-bdd9-40a1-be64-ad8458a57c81,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:21:37.791225 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-e83ac766-4cc1-4725-8f6a-1f0ee3a21600 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:21:38.033488 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-e83ac766-4cc1-4725-8f6a-1f0ee3a21600 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-581113', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-746586'] for router_interface, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:38.345183 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-750d2222-b867-4e57-b58a-e3339ecbf8f0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:38.411021 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e83ac766-4cc1-4725-8f6a-1f0ee3a21600 admin admin] Router 07f2d8c5-b60c-44e0-9523-33ce35fba7c1 has already been hosted by L3 agent 14610d92-0905-4c53-adb0-3c9460aa0460 {{(pid=92230) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 06:21:38.596485 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e83ac766-4cc1-4725-8f6a-1f0ee3a21600 admin admin] Notify agent at l3_agent.dv-cinder-793885-1-iscsi the message routers_updated {{(pid=92230) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 06:21:38.604813 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9016b16a-3581-4a58-af5e-c8a87277f8e5 None None] Sync routers for ids ['07f2d8c5-b60c-44e0-9523-33ce35fba7c1'] in dv-cinder-793885-1-iscsi {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 06:21:38.614878 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9016b16a-3581-4a58-af5e-c8a87277f8e5 None None] Routers {'07f2d8c5-b60c-44e0-9523-33ce35fba7c1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:21:38.615491 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-9016b16a-3581-4a58-af5e-c8a87277f8e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b26c4b80>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:21:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['07f2d8c5-b60c-44e0-9523-33ce35fba7c1'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:21:38.629597 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-e83ac766-4cc1-4725-8f6a-1f0ee3a21600 admin admin] 10.222.0.25 "PUT /v2.0/routers/07f2d8c5-b60c-44e0-9523-33ce35fba7c1/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.3849714
Jun 01 06:21:38.631414 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 41984) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:21:38.811344 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-9016b16a-3581-4a58-af5e-c8a87277f8e5 None None] Set router 07f2d8c5-b60c-44e0-9523-33ce35fba7c1 gateway port host: dv-cinder-793885-1-iscsi {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:21:38.921652 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ecc01862-e112-451b-b76b-b12873a1947d admin admin] Notify callbacks [] for router, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:39.156460 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ecc01862-e112-451b-b76b-b12873a1947d admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:39.158790 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-9016b16a-3581-4a58-af5e-c8a87277f8e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b26c4b80>, [{'id': '07f2d8c5-b60c-44e0-9523-33ce35fba7c1', 'name': 'tempest-TestVolumeBootPattern-1279291552-router', 'tenant_id': '59b1a5cf77d140469fb6596ad2fdef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'external_fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.224'}], 'enable_snat': True}, 'gw_port_id': '110f0bf5-38a0-4190-b9b1-e7dba8cb290e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:30Z', 'updated_at': '2021-06-01T06:21:37Z', 'revision_number': 5, 'project_id': '59b1a5cf77d140469fb6596ad2fdef03', 'gw_port': {'id': '110f0bf5-38a0-4190-b9b1-e7dba8cb290e', 'name': '', 'network_id': '83b812fb-2cfc-46e4-baa4-745218ea3ed2', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:36:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '07f2d8c5-b60c-44e0-9523-33ce35fba7c1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 364, 'fixed_ips': [{'subnet_id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'ip_address': '172.27.2.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793885-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T06:13:32Z', 'updated_at': '2021-06-01T06:13:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a59d7d11-a92c-4b4f-83cf-2095ecee2b51', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793885-1-iscsi'}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:21:39.162858 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9016b16a-3581-4a58-af5e-c8a87277f8e5 None None] Checking router: 07f2d8c5-b60c-44e0-9523-33ce35fba7c1 for host: dv-cinder-793885-1-iscsi {{(pid=92232) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 06:21:39.171993 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9016b16a-3581-4a58-af5e-c8a87277f8e5 None None] Routers {'07f2d8c5-b60c-44e0-9523-33ce35fba7c1'} bound to L3 agent in host dv-cinder-793885-1-iscsi {{(pid=92232) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 06:21:39.172522 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-9016b16a-3581-4a58-af5e-c8a87277f8e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fe3b26c4b80>, 'dv-cinder-793885-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T06:03:12Z,description=<?>,heartbeat_timestamp=2021-06-01T06:21:12Z,host='dv-cinder-793885-1-iscsi',id=14610d92-0905-4c53-adb0-3c9460aa0460,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T06:03:12Z,topic='l3_agent')) {'router_ids': ['07f2d8c5-b60c-44e0-9523-33ce35fba7c1'], 'active': True} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:21:39.235170 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [None req-ecc01862-e112-451b-b76b-b12873a1947d admin admin] Deleting port 110f0bf5-38a0-4190-b9b1-e7dba8cb290e {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:21:39.235502 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ecc01862-e112-451b-b76b-b12873a1947d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:39.333120 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_dvr_db [None req-9016b16a-3581-4a58-af5e-c8a87277f8e5 None None] Set router 07f2d8c5-b60c-44e0-9523-33ce35fba7c1 gateway port host: None {{(pid=92232) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 06:21:39.365342 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [None req-ecc01862-e112-451b-b76b-b12873a1947d admin admin] For port 110f0bf5-38a0-4190-b9b1-e7dba8cb290e, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=110f0bf5-38a0-4190-b9b1-e7dba8cb290e,segment=NetworkSegment(ad0428a0-0215-4be6-940c-57ddf2bfce55),segment_id=ad0428a0-0215-4be6-940c-57ddf2bfce55)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:21:39.365696 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ecc01862-e112-451b-b76b-b12873a1947d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:39.438389 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.l3_hamode_db [None req-9016b16a-3581-4a58-af5e-c8a87277f8e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fe3b26c4b80>, [{'id': '07f2d8c5-b60c-44e0-9523-33ce35fba7c1', 'name': 'tempest-TestVolumeBootPattern-1279291552-router', 'tenant_id': '59b1a5cf77d140469fb6596ad2fdef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:30Z', 'updated_at': '2021-06-01T06:21:39Z', 'revision_number': 6, 'project_id': '59b1a5cf77d140469fb6596ad2fdef03', 'gw_port_host': None}], 'dv-cinder-793885-1-iscsi', False) {} {{(pid=92232) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:21:39.442487 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9016b16a-3581-4a58-af5e-c8a87277f8e5 None None] The sync data for ids ['07f2d8c5-b60c-44e0-9523-33ce35fba7c1'] in dv-cinder-793885-1-iscsi is: [{'id': '07f2d8c5-b60c-44e0-9523-33ce35fba7c1', 'name': 'tempest-TestVolumeBootPattern-1279291552-router', 'tenant_id': '59b1a5cf77d140469fb6596ad2fdef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T06:13:30Z', 'updated_at': '2021-06-01T06:21:39Z', 'revision_number': 6, 'project_id': '59b1a5cf77d140469fb6596ad2fdef03', 'gw_port_host': None}] {{(pid=92232) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 06:21:39.497176 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [None req-ecc01862-e112-451b-b76b-b12873a1947d admin admin] Calling delete_port for 110f0bf5-38a0-4190-b9b1-e7dba8cb290e owned by network:router_gateway {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:21:39.648120 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ecc01862-e112-451b-b76b-b12873a1947d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:39.652382 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-3cd6d532-0bca-42f1-86b3-89d5c7c7f752 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:21:39.702514 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecc01862-e112-451b-b76b-b12873a1947d admin admin] Pushing event deleted for resources: {'Port': ['ID=110f0bf5-38a0-4190-b9b1-e7dba8cb290e,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:21:39.729469 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ecc01862-e112-451b-b76b-b12873a1947d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:21:39.797531 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ecc01862-e112-451b-b76b-b12873a1947d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-745687'] for router_gateway, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:39.976670 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ecc01862-e112-451b-b76b-b12873a1947d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-748122', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-727'] for router, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:39.978816 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ecc01862-e112-451b-b76b-b12873a1947d admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:40.002243 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ecc01862-e112-451b-b76b-b12873a1947d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-746854'] for router, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:40.002735 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ecc01862-e112-451b-b76b-b12873a1947d admin admin] Fanout notify agent at l3_agent the message router_deleted on router 07f2d8c5-b60c-44e0-9523-33ce35fba7c1 {{(pid=92229) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 06:21:40.015317 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-ecc01862-e112-451b-b76b-b12873a1947d admin admin] Notify callbacks [] for router, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:40.016476 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-ecc01862-e112-451b-b76b-b12873a1947d admin admin] 10.222.0.25 "DELETE /v2.0/routers/07f2d8c5-b60c-44e0-9523-33ce35fba7c1 HTTP/1.1" status: 204  len: 168 time: 1.3840673
Jun 01 06:21:40.019349 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 41994) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:21:40.082683 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_v2 [None req-325fc967-72c9-46d8-9da0-6896a14743c0 admin admin] Deleting subnet 8301243f-f3d8-4aba-9f42-177e554580b1 {{(pid=92229) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 06:21:40.085571 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-325fc967-72c9-46d8-9da0-6896a14743c0 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:40.133315 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-325fc967-72c9-46d8-9da0-6896a14743c0 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2127096'] for subnet, precommit_delete_associations {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:40.219579 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-325fc967-72c9-46d8-9da0-6896a14743c0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8086245'] for subnet, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:40.339624 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 110f0bf5-38a0-4190-b9b1-e7dba8cb290e no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:21:40.379071 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: 110f0bf5-38a0-4190-b9b1-e7dba8cb290e {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:21:40.379395 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 110f0bf5-38a0-4190-b9b1-e7dba8cb290e not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:21:40.380026 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 1fa94810-bdd9-40a1-be64-ad8458a57c81 no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:21:40.417721 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: 1fa94810-bdd9-40a1-be64-ad8458a57c81 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:21:40.418077 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 1fa94810-bdd9-40a1-be64-ad8458a57c81 not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:21:40.587464 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-325fc967-72c9-46d8-9da0-6896a14743c0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8087120', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1981457', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2134750'] for subnet, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:40.591921 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:21:40.631680 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-325fc967-72c9-46d8-9da0-6896a14743c0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8301243f-f3d8-4aba-9f42-177e554580b1,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:21:40.634795 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-325fc967-72c9-46d8-9da0-6896a14743c0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:21:40.636322 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-325fc967-72c9-46d8-9da0-6896a14743c0 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:40.641097 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ac4b8ec-b265-4b8d-ad48-dd7a5bffe32c None None] Network 5e198e3e-b0b7-4f03-a4b5-1307a1cfe333 requested from dv-cinder-793885-1-iscsi {{(pid=92231) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 06:21:40.645475 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-325fc967-72c9-46d8-9da0-6896a14743c0 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/8301243f-f3d8-4aba-9f42-177e554580b1 HTTP/1.1" status: 204  len: 168 time: 0.6228790
Jun 01 06:21:40.645716 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [-] (92229) accepted ('10.222.0.25', 41998) {{(pid=92229) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:21:40.755158 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8063377'] for network, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:40.833307 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] Deleting port 8c540a0d-e1ed-4b75-9238-d7951633d4bc {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:21:40.833644 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:40.888147 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ebdc9c2-71a8-460a-bf5c-3cf23ad70b92 None None] DHCP port deletion for 5e198e3e-b0b7-4f03-a4b5-1307a1cfe333 request from dv-cinder-793885-1-iscsi {{(pid=92231) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 06:21:40.941339 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] For port 8c540a0d-e1ed-4b75-9238-d7951633d4bc, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=8c540a0d-e1ed-4b75-9238-d7951633d4bc,segment=NetworkSegment(82caaa19-2534-4a80-96d3-c3f641675978),segment_id=82caaa19-2534-4a80-96d3-c3f641675978)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:21:40.941695 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:40.958502 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-3ebdc9c2-71a8-460a-bf5c-3cf23ad70b92 None None] Deleting port 8c540a0d-e1ed-4b75-9238-d7951633d4bc {{(pid=92231) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:21:40.958880 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-3ebdc9c2-71a8-460a-bf5c-3cf23ad70b92 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:41.068132 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-3ebdc9c2-71a8-460a-bf5c-3cf23ad70b92 None None] For port 8c540a0d-e1ed-4b75-9238-d7951633d4bc, host dv-cinder-793885-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793885-1-iscsi',level=0,port_id=8c540a0d-e1ed-4b75-9238-d7951633d4bc,segment=NetworkSegment(82caaa19-2534-4a80-96d3-c3f641675978),segment_id=82caaa19-2534-4a80-96d3-c3f641675978)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:21:41.068527 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-3ebdc9c2-71a8-460a-bf5c-3cf23ad70b92 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:41.071486 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] Calling delete_port for 8c540a0d-e1ed-4b75-9238-d7951633d4bc owned by network:dhcp {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:21:41.121115 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:41.129236 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-261be639-9737-492c-8215-d7bdf53d4497 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:21:41.173463 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] Pushing event deleted for resources: {'Port': ['ID=8c540a0d-e1ed-4b75-9238-d7951633d4bc,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:21:41.176467 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:21:41.177257 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] No DVR routers for this DVR port 8c540a0d-e1ed-4b75-9238-d7951633d4bc on host dv-cinder-793885-1-iscsi {{(pid=92229) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:21:41.199286 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-3ebdc9c2-71a8-460a-bf5c-3cf23ad70b92 None None] Calling delete_port for 8c540a0d-e1ed-4b75-9238-d7951633d4bc owned by network:dhcp {{(pid=92231) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:21:41.254496 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:41.261484 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-3ebdc9c2-71a8-460a-bf5c-3cf23ad70b92 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756'] for port, after_delete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:41.266004 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:21:41.299360 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8093290', 'neutron.services.segments.db._delete_segments_for_network-8788497006300'] for network, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:41.314023 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe3b1c85ca0>,) {'filters': {'network_id': ['5e198e3e-b0b7-4f03-a4b5-1307a1cfe333']}} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:21:41.318523 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ebdc9c2-71a8-460a-bf5c-3cf23ad70b92 None None] Pushing event deleted for resources: {'Port': ['ID=8c540a0d-e1ed-4b75-9238-d7951633d4bc,revision_number=None']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:21:41.323074 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ebdc9c2-71a8-460a-bf5c-3cf23ad70b92 None None] No DVR routers for this DVR port 8c540a0d-e1ed-4b75-9238-d7951633d4bc on host dv-cinder-793885-1-iscsi {{(pid=92231) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:21:41.328243 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b1c85ca0>, '82caaa19-2534-4a80-96d3-c3f641675978') {'for_net_delete': True} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:21:41.329037 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.services.segments.db [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b1c85ca0>, '82caaa19-2534-4a80-96d3-c3f641675978') {} {{(pid=92229) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:21:41.336721 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ebdc9c2-71a8-460a-bf5c-3cf23ad70b92 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:41.336721 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ebdc9c2-71a8-460a-bf5c-3cf23ad70b92 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:41.336721 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ebdc9c2-71a8-460a-bf5c-3cf23ad70b92 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:41.336721 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ebdc9c2-71a8-460a-bf5c-3cf23ad70b92 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:41.336721 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ebdc9c2-71a8-460a-bf5c-3cf23ad70b92 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:41.336721 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ebdc9c2-71a8-460a-bf5c-3cf23ad70b92 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:41.336721 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ebdc9c2-71a8-460a-bf5c-3cf23ad70b92 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:41.336721 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ebdc9c2-71a8-460a-bf5c-3cf23ad70b92 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:41.336721 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ebdc9c2-71a8-460a-bf5c-3cf23ad70b92 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:41.336721 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ebdc9c2-71a8-460a-bf5c-3cf23ad70b92 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:41.337725 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ebdc9c2-71a8-460a-bf5c-3cf23ad70b92 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:41.337725 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ebdc9c2-71a8-460a-bf5c-3cf23ad70b92 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92231) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:41.342029 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-3ebdc9c2-71a8-460a-bf5c-3cf23ad70b92 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:21:41.345876 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8788497014941', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2127091'] for segment, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:41.365657 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:41.372790 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] Releasing vlan 220 on physical network physnet1 to pool {{(pid=92229) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 06:21:41.373109 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2077367'] for segment, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]: Traceback (most recent call last):
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:     timer()
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:     cb(*args, **kw)
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:     return func(*args, **kwargs)
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:     self._notify()
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:     self.callback(batched_events)
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:     event.method(event)
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:     return f(self, *a, **k)
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self._get(url).json()
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:     return self.request(url, 'GET', **kwargs)
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 06:21:41.386525 dv-cinder-793885-1-iscsi neutron-server[92229]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 06:21:41.467343 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8093283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-745674'] for network, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:41.470908 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-4a647cca-d763-427e-9b7b-cf896b0f4527 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:21:41.484983 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:41.495203 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] Pushing event deleted for resources: {'Network': ['ID=5e198e3e-b0b7-4f03-a4b5-1307a1cfe333,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:21:41.500104 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:21:41.503487 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] 10.222.0.25 "DELETE /v2.0/networks/5e198e3e-b0b7-4f03-a4b5-1307a1cfe333 HTTP/1.1" status: 204  len: 168 time: 0.8568549
Jun 01 06:21:41.625205 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 42006) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:21:41.683471 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-bb911784-9ca5-47e2-acea-f4fa71737037 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=e8bcff3fed924886a68a8562a9f4f8f3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0558631
Jun 01 06:21:41.686247 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 42010) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:21:41.760533 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2bdc4517-8dca-46a4-ac62-3f4a52ae9149 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:41.792604 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2bdc4517-8dca-46a4-ac62-3f4a52ae9149 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:41.852074 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2bdc4517-8dca-46a4-ac62-3f4a52ae9149 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:41.856402 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-0cf7f2d6-a84f-4f48-8a33-ba20c04d4783 tempest-AttachVolumeShelveTestJSON-1041480953 tempest-AttachVolumeShelveTestJSON-1041480953-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:21:41.870872 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bdc4517-8dca-46a4-ac62-3f4a52ae9149 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=300675cd-3b27-4591-af6a-7d56779c5314,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:21:41.875714 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-2bdc4517-8dca-46a4-ac62-3f4a52ae9149 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:21:41.879112 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-2bdc4517-8dca-46a4-ac62-3f4a52ae9149 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:41.880246 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-2bdc4517-8dca-46a4-ac62-3f4a52ae9149 admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/300675cd-3b27-4591-af6a-7d56779c5314 HTTP/1.1" status: 204  len: 168 time: 0.1927717
Jun 01 06:21:42.245313 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 42020) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:21:42.296736 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-ba432fe2-01de-4f6b-b9bf-85dbbac53fee admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=59b1a5cf77d140469fb6596ad2fdef03&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0500522
Jun 01 06:21:42.299056 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 42024) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:21:42.345124 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 8c540a0d-e1ed-4b75-9238-d7951633d4bc no longer exists at agent ovs-agent-dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:21:42.375769 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f236145e-9d9d-46ec-84f7-876faae101ee admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:42.385388 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] No Port match for: 8c540a0d-e1ed-4b75-9238-d7951633d4bc {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:21:42.385779 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Device 8c540a0d-e1ed-4b75-9238-d7951633d4bc not bound to the agent host dv-cinder-793885-1-iscsi {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:21:42.397565 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-9db2c7fc-ab07-45a9-a3cb-11375c2611cd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:42.414090 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f236145e-9d9d-46ec-84f7-876faae101ee admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:42.479645 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f236145e-9d9d-46ec-84f7-876faae101ee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:42.483875 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-dedb0639-c0a1-4e04-9859-4f6d83e8abb3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:21:42.495411 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f236145e-9d9d-46ec-84f7-876faae101ee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e1ba825d-93c9-4f29-ba44-2b52e5063c06,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:21:42.499544 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-f236145e-9d9d-46ec-84f7-876faae101ee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:21:42.503214 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-f236145e-9d9d-46ec-84f7-876faae101ee admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:42.504638 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-f236145e-9d9d-46ec-84f7-876faae101ee admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/e1ba825d-93c9-4f29-ba44-2b52e5063c06 HTTP/1.1" status: 204  len: 168 time: 0.2042801
Jun 01 06:21:43.298152 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:45.393867 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:46.052461 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:49.293130 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-450dce6b-a6c6-4119-803f-fa7f7c142572 req-d2785c3d-8414-428d-a688-c604c01c7357 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:49.294656 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-450dce6b-a6c6-4119-803f-fa7f7c142572 req-d2785c3d-8414-428d-a688-c604c01c7357 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=31268529-11c5-4481-a0db-bbace95bfe27 HTTP/1.1" status: 200  len: 946 time: 0.0815749
Jun 01 06:21:49.341838 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-450dce6b-a6c6-4119-803f-fa7f7c142572 req-9cc34835-1609-42cd-adc0-fd36be9f27d3 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/security-groups?id=23991ca1-e8b0-4439-8006-3ce171b2642b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406542
Jun 01 06:21:50.539755 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb0768e6-c9b3-437e-84c3-3ec10e2fa47a req-efc65943-bf69-48d4-8c0f-163a0dde5fda tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:50.541194 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fb0768e6-c9b3-437e-84c3-3ec10e2fa47a req-efc65943-bf69-48d4-8c0f-163a0dde5fda tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=31268529-11c5-4481-a0db-bbace95bfe27 HTTP/1.1" status: 200  len: 946 time: 0.0899208
Jun 01 06:21:50.591687 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fb0768e6-c9b3-437e-84c3-3ec10e2fa47a req-a3b87a7c-d8a2-40fb-8c31-f4f3f794789c tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/security-groups?id=23991ca1-e8b0-4439-8006-3ce171b2642b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0429902
Jun 01 06:21:50.790982 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbe25064-d518-400c-9d03-a6f9fe4a5dd8 req-0483ed13-cdc5-445c-b8f5-67bf80cdcf7d tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:21:50.792339 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bbe25064-d518-400c-9d03-a6f9fe4a5dd8 req-0483ed13-cdc5-445c-b8f5-67bf80cdcf7d tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.48 "GET /v2.0/ports?device_id=31268529-11c5-4481-a0db-bbace95bfe27 HTTP/1.1" status: 200  len: 946 time: 0.0776331
Jun 01 06:21:50.931249 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-bbe25064-d518-400c-9d03-a6f9fe4a5dd8 req-ba89d692-118e-4641-a2c2-5d63ce04cc2b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Deleting port b9282008-074c-414a-9a07-9a49782d2a84 {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:21:50.931588 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-bbe25064-d518-400c-9d03-a6f9fe4a5dd8 req-ba89d692-118e-4641-a2c2-5d63ce04cc2b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:51.068264 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-bbe25064-d518-400c-9d03-a6f9fe4a5dd8 req-ba89d692-118e-4641-a2c2-5d63ce04cc2b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] For port b9282008-074c-414a-9a07-9a49782d2a84, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=b9282008-074c-414a-9a07-9a49782d2a84,segment=NetworkSegment(8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e),segment_id=8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:21:51.068518 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-bbe25064-d518-400c-9d03-a6f9fe4a5dd8 req-ba89d692-118e-4641-a2c2-5d63ce04cc2b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:51.300116 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-bbe25064-d518-400c-9d03-a6f9fe4a5dd8 req-ba89d692-118e-4641-a2c2-5d63ce04cc2b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Calling delete_port for b9282008-074c-414a-9a07-9a49782d2a84 owned by compute:nova {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:21:51.424854 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-bbe25064-d518-400c-9d03-a6f9fe4a5dd8 req-ba89d692-118e-4641-a2c2-5d63ce04cc2b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:51.430504 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-e44336f1-4f32-4352-9f4a-30c9311db003 tempest-VolumesActionsTest-1536711119 tempest-VolumesActionsTest-1536711119-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:21:51.436226 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['b9282008-074c-414a-9a07-9a49782d2a84'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:21:51.479846 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba89d692-118e-4641-a2c2-5d63ce04cc2b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Pushing event deleted for resources: {'Port': ['ID=b9282008-074c-414a-9a07-9a49782d2a84,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:21:51.513610 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba89d692-118e-4641-a2c2-5d63ce04cc2b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:51.513990 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba89d692-118e-4641-a2c2-5d63ce04cc2b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:51.514356 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba89d692-118e-4641-a2c2-5d63ce04cc2b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:51.514719 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba89d692-118e-4641-a2c2-5d63ce04cc2b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:51.515075 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba89d692-118e-4641-a2c2-5d63ce04cc2b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:51.515433 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba89d692-118e-4641-a2c2-5d63ce04cc2b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:51.515823 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba89d692-118e-4641-a2c2-5d63ce04cc2b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:51.516240 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba89d692-118e-4641-a2c2-5d63ce04cc2b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:51.516591 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba89d692-118e-4641-a2c2-5d63ce04cc2b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:51.516944 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba89d692-118e-4641-a2c2-5d63ce04cc2b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:51.517304 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba89d692-118e-4641-a2c2-5d63ce04cc2b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:51.517657 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba89d692-118e-4641-a2c2-5d63ce04cc2b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92229) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:21:51.525672 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-ba89d692-118e-4641-a2c2-5d63ce04cc2b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:21:51.565476 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-bbe25064-d518-400c-9d03-a6f9fe4a5dd8 req-ba89d692-118e-4641-a2c2-5d63ce04cc2b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] No DVR routers for this DVR port b9282008-074c-414a-9a07-9a49782d2a84 on host hv-cinder-79388 {{(pid=92229) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:21:51.568035 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-bbe25064-d518-400c-9d03-a6f9fe4a5dd8 req-ba89d692-118e-4641-a2c2-5d63ce04cc2b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:21:51.570651 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '31268529-11c5-4481-a0db-bbace95bfe27', 'name': 'network-vif-deleted', 'tag': 'b9282008-074c-414a-9a07-9a49782d2a84'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:21:51.572940 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ad28e511-450f-4a88-ae2a-6e573198d2ee" -d '{"events": [{"server_uuid": "31268529-11c5-4481-a0db-bbace95bfe27", "name": "network-vif-deleted", "tag": "b9282008-074c-414a-9a07-9a49782d2a84"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:21:51.588082 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bbe25064-d518-400c-9d03-a6f9fe4a5dd8 req-ba89d692-118e-4641-a2c2-5d63ce04cc2b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.48 "DELETE /v2.0/ports/b9282008-074c-414a-9a07-9a49782d2a84 HTTP/1.1" status: 204  len: 173 time: 0.7905843
Jun 01 06:21:51.617073 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:21:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9787ce20-3777-4bd1-9523-e624f83073d8 x-openstack-request-id: req-9787ce20-3777-4bd1-9523-e624f83073d8 {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:21:51.617508 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "31268529-11c5-4481-a0db-bbace95bfe27", "name": "network-vif-deleted", "tag": "b9282008-074c-414a-9a07-9a49782d2a84", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:21:51.617711 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-9787ce20-3777-4bd1-9523-e624f83073d8 {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:21:51.618241 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '31268529-11c5-4481-a0db-bbace95bfe27', 'name': 'network-vif-deleted', 'tag': 'b9282008-074c-414a-9a07-9a49782d2a84', 'status': 'completed', 'code': 200}
Jun 01 06:21:51.757779 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-8d289355-69d4-4897-9699-5bb6e45ab4a2 req-7400c599-36e0-4c96-8441-9af0161d710a tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Synchronizing usage tracker for tenant:e4915685ec04413092ab2058fb1fa324 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:21:51.778430 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-8d289355-69d4-4897-9699-5bb6e45ab4a2 req-7400c599-36e0-4c96-8441-9af0161d710a tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Unset dirty status for tenant:e4915685ec04413092ab2058fb1fa324 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:21:51.780200 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-8d289355-69d4-4897-9699-5bb6e45ab4a2 req-7400c599-36e0-4c96-8441-9af0161d710a tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=31268529-11c5-4481-a0db-bbace95bfe27 HTTP/1.1" status: 200  len: 210 time: 0.0726042
Jun 01 06:21:55.139615 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device b9282008-074c-414a-9a07-9a49782d2a84 no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:21:55.220688 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] No Port match for: b9282008-074c-414a-9a07-9a49782d2a84 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:21:55.221063 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device b9282008-074c-414a-9a07-9a49782d2a84 not bound to the agent host hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:21:58.722962 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:22:02.362896 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-7cf20701-7c3e-4f28-9266-b96368ebb023 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:22:02.364356 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-7cf20701-7c3e-4f28-9266-b96368ebb023 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/networks?id=4d8cd222-c2f9-4d3c-934c-dba6dfa184ac HTTP/1.1" status: 200  len: 814 time: 0.1514242
Jun 01 06:22:02.379040 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-7a456a8e-20f5-410c-8efd-e6bfd3774a2f tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/quotas/e4915685ec04413092ab2058fb1fa324 HTTP/1.1" status: 200  len: 375 time: 0.0091946
Jun 01 06:22:02.427282 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-bc9cb4e9-3bb2-49a0-849d-0f7321238caf tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?tenant_id=e4915685ec04413092ab2058fb1fa324&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0428941
Jun 01 06:22:02.544947 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-0403ceef-fbd8-497a-b244-4223ab202879 service neutron] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=92229) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 06:22:02.545926 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-0403ceef-fbd8-497a-b244-4223ab202879 service neutron] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.1103535
Jun 01 06:22:02.678680 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-fb7f8521-faa3-4431-a406-0c96899878d3 service neutron] 10.222.0.25 "GET /v2.0/networks/4d8cd222-c2f9-4d3c-934c-dba6dfa184ac?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1268239
Jun 01 06:22:02.813665 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-68c99d22-6f50-45b5-9d1b-c455b180a14e service neutron] 10.222.0.25 "GET /v2.0/networks/4d8cd222-c2f9-4d3c-934c-dba6dfa184ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1290355
Jun 01 06:22:02.992418 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-1391619e-ccb3-4ff9-bd13-fe8623abfbfd req-11f16854-aaa3-4764-9f90-5e5ffc32f4c9 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=c1798ceb-b026-4db4-a559-b3b374a7e1a7 HTTP/1.1" status: 200  len: 210 time: 0.0435591
Jun 01 06:22:04.176784 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-2db0b4ee-ed15-41ef-81b7-7319c91997f9 req-478ef8a1-2799-425c-9137-32d8bda65590 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=c1798ceb-b026-4db4-a559-b3b374a7e1a7 HTTP/1.1" status: 200  len: 210 time: 0.0616112
Jun 01 06:22:04.241678 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-df4c2ddb-b831-4ff5-8c80-7ed4505b89d5 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:22:04.243135 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-df4c2ddb-b831-4ff5-8c80-7ed4505b89d5 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.48 "GET /v2.0/networks?id=4d8cd222-c2f9-4d3c-934c-dba6dfa184ac HTTP/1.1" status: 200  len: 814 time: 0.2090244
Jun 01 06:22:04.265043 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-b7fe1f16-34db-4014-99d9-d281f3e0e4f0 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Request body: {'port': {'device_id': 'c1798ceb-b026-4db4-a559-b3b374a7e1a7', 'network_id': '4d8cd222-c2f9-4d3c-934c-dba6dfa184ac', 'admin_state_up': True, 'tenant_id': 'e4915685ec04413092ab2058fb1fa324'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:22:04.410353 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-b7fe1f16-34db-4014-99d9-d281f3e0e4f0 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 06:22:04.419707 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.quota.driver [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-b7fe1f16-34db-4014-99d9-d281f3e0e4f0 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92229) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 06:22:04.428806 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-b7fe1f16-34db-4014-99d9-d281f3e0e4f0 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Made reservation on behalf of e4915685ec04413092ab2058fb1fa324 for: {'port': 1} {{(pid=92229) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 06:22:04.432590 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-b7fe1f16-34db-4014-99d9-d281f3e0e4f0 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:04.602971 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.db_base_plugin_common [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-b7fe1f16-34db-4014-99d9-d281f3e0e4f0 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Allocated IP 172.20.0.5 (4d8cd222-c2f9-4d3c-934c-dba6dfa184ac/d6fc7f9a-efe9-45b9-9679-8f49743dcb31/56c9fb4e-baeb-4c63-a801-0bbf2eec2068) {{(pid=92229) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 06:22:04.915044 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-b7fe1f16-34db-4014-99d9-d281f3e0e4f0 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Notify callbacks [] for port, precommit_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:04.945907 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-b7fe1f16-34db-4014-99d9-d281f3e0e4f0 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8788496545747', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_create {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:04.951638 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-7e86f32a-7296-4d40-be9e-cc6844479838 tempest-TestVolumeBootPattern-1575646656 tempest-TestVolumeBootPattern-1575646656-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:22:05.019349 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-b7fe1f16-34db-4014-99d9-d281f3e0e4f0 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Network 4d8cd222-c2f9-4d3c-934c-dba6dfa184ac is already hosted by enough agents. {{(pid=92229) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 06:22:05.022546 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.scheduler.base_scheduler [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-b7fe1f16-34db-4014-99d9-d281f3e0e4f0 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Resources bound (agent type, host, resource id):  {{(pid=92229) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 06:22:05.026432 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-b7fe1f16-34db-4014-99d9-d281f3e0e4f0 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Received port after_create {{(pid=92229) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 06:22:05.063867 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7fe1f16-34db-4014-99d9-d281f3e0e4f0 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Pushing event updated for resources: {'Port': ['ID=56c9fb4e-baeb-4c63-a801-0bbf2eec2068,revision_number=1']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:22:05.070318 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-b7fe1f16-34db-4014-99d9-d281f3e0e4f0 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:22:05.099765 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-b7fe1f16-34db-4014-99d9-d281f3e0e4f0 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:22:05.100390 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-b7fe1f16-34db-4014-99d9-d281f3e0e4f0 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:05.126600 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-b7fe1f16-34db-4014-99d9-d281f3e0e4f0 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.48 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.8691487
Jun 01 06:22:05.136429 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-6ab2705b-7273-4ec5-ba34-48c3b1d6ba40 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] http://10.222.0.25:9696/v2.0/extensions returned with HTTP 200 {{(pid=92229) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 06:22:05.137341 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-6ab2705b-7273-4ec5-ba34-48c3b1d6ba40 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.48 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0049791
Jun 01 06:22:05.201007 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.v2.base [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] Request body: {'port': {'device_id': 'c1798ceb-b026-4db4-a559-b3b374a7e1a7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79388'}} {{(pid=92229) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 06:22:05.365477 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:05.466086 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed8f138-3470-4840-b8e6-8c2b9c152225 req-e705781b-2b51-4e1d-93e8-dbe4ff849a02 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:22:05.466932 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-aed8f138-3470-4840-b8e6-8c2b9c152225 req-e705781b-2b51-4e1d-93e8-dbe4ff849a02 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Synchronizing usage tracker for tenant:e4915685ec04413092ab2058fb1fa324 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:22:05.539864 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-aed8f138-3470-4840-b8e6-8c2b9c152225 req-e705781b-2b51-4e1d-93e8-dbe4ff849a02 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Unset dirty status for tenant:e4915685ec04413092ab2058fb1fa324 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:22:05.541058 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-aed8f138-3470-4840-b8e6-8c2b9c152225 req-e705781b-2b51-4e1d-93e8-dbe4ff849a02 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=c1798ceb-b026-4db4-a559-b3b374a7e1a7 HTTP/1.1" status: 200  len: 931 time: 0.2483363
Jun 01 06:22:05.677148 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-aed8f138-3470-4840-b8e6-8c2b9c152225 req-06603f35-6417-46c6-8542-1ae9dea7082c tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/security-groups?id=23991ca1-e8b0-4439-8006-3ce171b2642b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1287153
Jun 01 06:22:05.791491 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 56c9fb4e-baeb-4c63-a801-0bbf2eec2068 {{(pid=92229) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:22:05.799330 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:05.813954 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.provisioning_blocks [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] Transition to ACTIVE for port object 56c9fb4e-baeb-4c63-a801-0bbf2eec2068 will not be triggered until provisioned by entity L2. {{(pid=92229) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 06:22:05.817875 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2077419'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:05.821835 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-7a827f18-32bb-4f57-ad28-a765139f3484 tempest-TestShelveInstance-1522358508 tempest-TestShelveInstance-1522358508-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:22:05.971323 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] Pushing event updated for resources: {'Port': ['ID=56c9fb4e-baeb-4c63-a801-0bbf2eec2068,revision_number=2']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:22:05.978701 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:22:06.051410 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] Attempting to bind port 56c9fb4e-baeb-4c63-a801-0bbf2eec2068 on host hv-cinder-79388 for vnic_type normal with profile  {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 06:22:06.051653 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] Attempting to bind port 56c9fb4e-baeb-4c63-a801-0bbf2eec2068 by drivers openvswitch,hyperv on host hv-cinder-79388 at level 0 using segments [{'id': '8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 221, 'network_id': '4d8cd222-c2f9-4d3c-934c-dba6dfa184ac'}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 06:22:06.052004 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] Attempting to bind port 56c9fb4e-baeb-4c63-a801-0bbf2eec2068 on network 4d8cd222-c2f9-4d3c-934c-dba6dfa184ac {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:22:06.056617 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] Port 56c9fb4e-baeb-4c63-a801-0bbf2eec2068 on network 4d8cd222-c2f9-4d3c-934c-dba6dfa184ac not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79388 {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 06:22:06.056934 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] Attempting to bind port 56c9fb4e-baeb-4c63-a801-0bbf2eec2068 on network 4d8cd222-c2f9-4d3c-934c-dba6dfa184ac {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 06:22:06.062359 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] Checking agent: {'id': '56148394-2131-4d06-bcfa-c032301591b8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79388', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'started_at': datetime.datetime(2021, 6, 1, 6, 9, 45), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 6, 21, 46), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 06:22:06.062948 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] Checking segment: {'id': '8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 221, 'network_id': '4d8cd222-c2f9-4d3c-934c-dba6dfa184ac'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92229) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 06:22:06.063328 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] Bound using segment: {'id': '8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 221, 'network_id': '4d8cd222-c2f9-4d3c-934c-dba6dfa184ac'} {{(pid=92229) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 06:22:06.063745 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.managers [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] Bound port: 56c9fb4e-baeb-4c63-a801-0bbf2eec2068, host: hv-cinder-79388, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 221, 'network_id': '4d8cd222-c2f9-4d3c-934c-dba6dfa184ac'}}] {{(pid=92229) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 06:22:06.064109 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:06.154170 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] For port 56c9fb4e-baeb-4c63-a801-0bbf2eec2068, host hv-cinder-79388, cleared binding levels {{(pid=92229) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 06:22:06.157379 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] For port 56c9fb4e-baeb-4c63-a801-0bbf2eec2068, host hv-cinder-79388, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=56c9fb4e-baeb-4c63-a801-0bbf2eec2068,segment=NetworkSegment(8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e),segment_id=8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e)] {{(pid=92229) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 06:22:06.160718 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2077419'] for port, after_update {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:06.165194 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-8e6caf64-d0c2-4052-a68f-773b4c2e7bf0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:22:06.213108 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:22:06.213719 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:06.215104 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] 10.222.0.48 "PUT /v2.0/ports/56c9fb4e-baeb-4c63-a801-0bbf2eec2068 HTTP/1.1" status: 200  len: 1093 time: 1.0710020
Jun 01 06:22:06.223149 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c1798ceb-b026-4db4-a559-b3b374a7e1a7', 'tag': '56c9fb4e-baeb-4c63-a801-0bbf2eec2068'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:22:06.225499 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-08e24906-e24c-46ae-aaf6-2e62f8f9f746" -d '{"events": [{"name": "network-changed", "server_uuid": "c1798ceb-b026-4db4-a559-b3b374a7e1a7", "tag": "56c9fb4e-baeb-4c63-a801-0bbf2eec2068"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:22:06.283495 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 06:22:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f2006c99-3825-4d87-a78e-25aa51ee5c3b x-openstack-request-id: req-f2006c99-3825-4d87-a78e-25aa51ee5c3b {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:22:06.283846 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c1798ceb-b026-4db4-a559-b3b374a7e1a7", "tag": "56c9fb4e-baeb-4c63-a801-0bbf2eec2068", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:22:06.284135 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-f2006c99-3825-4d87-a78e-25aa51ee5c3b {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:22:06.284561 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c1798ceb-b026-4db4-a559-b3b374a7e1a7', 'tag': '56c9fb4e-baeb-4c63-a801-0bbf2eec2068', 'status': 'completed', 'code': 200}
Jun 01 06:22:06.289321 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] Pushing event updated for resources: {'Port': ['ID=56c9fb4e-baeb-4c63-a801-0bbf2eec2068,revision_number=3']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:22:06.296783 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-008f42bb-fe0b-4bdd-8560-aa25d84005b1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:22:06.331483 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-04935493-d49b-4ee1-afa0-db8c7179fff3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:22:06.333090 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-04935493-d49b-4ee1-afa0-db8c7179fff3 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=e4915685ec04413092ab2058fb1fa324&device_id=c1798ceb-b026-4db4-a559-b3b374a7e1a7 HTTP/1.1" status: 200  len: 1096 time: 0.0824745
Jun 01 06:22:06.404984 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-eb20e558-0086-40c4-abcf-e35e058b1919 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=56c9fb4e-baeb-4c63-a801-0bbf2eec2068 HTTP/1.1" status: 200  len: 217 time: 0.0650492
Jun 01 06:22:06.467466 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-ba0ca036-4bfe-4d64-b2ea-69f98b031229 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:22:06.468914 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-ba0ca036-4bfe-4d64-b2ea-69f98b031229 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=d6fc7f9a-efe9-45b9-9679-8f49743dcb31 HTTP/1.1" status: 200  len: 854 time: 0.0585356
Jun 01 06:22:06.516474 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-8450dcf6-ba24-4b02-9b37-0000c7df3a1a service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=4d8cd222-c2f9-4d3c-934c-dba6dfa184ac&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0405664
Jun 01 06:22:06.651207 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-a78c68c2-a41f-4cf2-898f-0003001bf2d1 service neutron] 10.222.0.48 "GET /v2.0/networks/4d8cd222-c2f9-4d3c-934c-dba6dfa184ac?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1285479
Jun 01 06:22:06.953759 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-e39e7e2c-d38e-4124-9628-67ba19ace04d req-4055e3e8-11c3-49f4-8ea9-2a8d1a8911f5 service neutron] 10.222.0.48 "GET /v2.0/networks/4d8cd222-c2f9-4d3c-934c-dba6dfa184ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2954676
Jun 01 06:22:06.968868 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4524b66d-ab0f-41e6-9c50-7c9ec94c8721 req-c4a52831-8adf-4cbd-ae1d-e97bc385bfc8 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:22:06.970375 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4524b66d-ab0f-41e6-9c50-7c9ec94c8721 req-c4a52831-8adf-4cbd-ae1d-e97bc385bfc8 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=c1798ceb-b026-4db4-a559-b3b374a7e1a7 HTTP/1.1" status: 200  len: 943 time: 0.1318033
Jun 01 06:22:07.059932 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-4524b66d-ab0f-41e6-9c50-7c9ec94c8721 req-c912677f-d080-40bc-b1e0-2c7861d7a41f tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/security-groups?id=23991ca1-e8b0-4439-8006-3ce171b2642b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0821612
Jun 01 06:22:07.087387 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08e24906-e24c-46ae-aaf6-2e62f8f9f746 req-edab0cf6-51f8-4223-967a-26e4fb44e646 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:22:07.088918 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-08e24906-e24c-46ae-aaf6-2e62f8f9f746 req-edab0cf6-51f8-4223-967a-26e4fb44e646 service neutron] 10.222.0.48 "GET /v2.0/ports?tenant_id=e4915685ec04413092ab2058fb1fa324&device_id=c1798ceb-b026-4db4-a559-b3b374a7e1a7 HTTP/1.1" status: 200  len: 1096 time: 0.0908318
Jun 01 06:22:07.221762 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08e24906-e24c-46ae-aaf6-2e62f8f9f746 req-9573b5eb-c875-40e0-a2d7-372fb995cc69 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:22:07.223104 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-08e24906-e24c-46ae-aaf6-2e62f8f9f746 req-9573b5eb-c875-40e0-a2d7-372fb995cc69 service neutron] 10.222.0.48 "GET /v2.0/networks?id=4d8cd222-c2f9-4d3c-934c-dba6dfa184ac HTTP/1.1" status: 200  len: 915 time: 0.1271768
Jun 01 06:22:07.293419 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-08e24906-e24c-46ae-aaf6-2e62f8f9f746 req-2ea5ac15-025d-46d5-aaae-6cafb52249e4 service neutron] 10.222.0.48 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=56c9fb4e-baeb-4c63-a801-0bbf2eec2068 HTTP/1.1" status: 200  len: 217 time: 0.0616357
Jun 01 06:22:07.360671 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08e24906-e24c-46ae-aaf6-2e62f8f9f746 req-81d6b5a4-174a-4c6f-8041-f5792864b3e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:22:07.362096 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-08e24906-e24c-46ae-aaf6-2e62f8f9f746 req-81d6b5a4-174a-4c6f-8041-f5792864b3e7 service neutron] 10.222.0.48 "GET /v2.0/subnets?id=d6fc7f9a-efe9-45b9-9679-8f49743dcb31 HTTP/1.1" status: 200  len: 854 time: 0.0620978
Jun 01 06:22:07.410181 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-08e24906-e24c-46ae-aaf6-2e62f8f9f746 req-08d82611-4532-403f-b4d2-f942b059f28b service neutron] 10.222.0.48 "GET /v2.0/ports?network_id=4d8cd222-c2f9-4d3c-934c-dba6dfa184ac&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0404921
Jun 01 06:22:07.545354 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-08e24906-e24c-46ae-aaf6-2e62f8f9f746 req-5193fb17-cc81-4937-b109-9cbbeda85013 service neutron] 10.222.0.48 "GET /v2.0/networks/4d8cd222-c2f9-4d3c-934c-dba6dfa184ac?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1274853
Jun 01 06:22:07.679182 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-08e24906-e24c-46ae-aaf6-2e62f8f9f746 req-86fcf20c-b00c-41e8-9a9b-97796abdfb86 service neutron] 10.222.0.48 "GET /v2.0/networks/4d8cd222-c2f9-4d3c-934c-dba6dfa184ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1268582
Jun 01 06:22:08.253158 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28e0aa7a-47d5-4ece-aca2-e3f8f1fae3b2 req-930e0bcd-376b-41c7-aa3d-5ddfbbc60d29 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:22:08.254693 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-28e0aa7a-47d5-4ece-aca2-e3f8f1fae3b2 req-930e0bcd-376b-41c7-aa3d-5ddfbbc60d29 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=c1798ceb-b026-4db4-a559-b3b374a7e1a7 HTTP/1.1" status: 200  len: 943 time: 0.0871859
Jun 01 06:22:08.300827 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-28e0aa7a-47d5-4ece-aca2-e3f8f1fae3b2 req-9e8c9219-5d58-426e-9834-4315b8981912 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/security-groups?id=23991ca1-e8b0-4439-8006-3ce171b2642b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0404284
Jun 01 06:22:08.330634 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-6d258846-2312-48a4-8500-905432b26f39 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:09.493742 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e48dc79-bc8a-4ba5-b085-9320292089a2 req-78cb54bb-cb00-42c0-8459-5e963b407f69 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:22:09.495441 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7e48dc79-bc8a-4ba5-b085-9320292089a2 req-78cb54bb-cb00-42c0-8459-5e963b407f69 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=c1798ceb-b026-4db4-a559-b3b374a7e1a7 HTTP/1.1" status: 200  len: 943 time: 0.0869067
Jun 01 06:22:09.543346 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-7e48dc79-bc8a-4ba5-b085-9320292089a2 req-b45a7e43-529f-4c0a-8aba-5ccca7083c64 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/security-groups?id=23991ca1-e8b0-4439-8006-3ce171b2642b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409827
Jun 01 06:22:10.738014 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07023d1b-089b-4b49-a933-3ee432e5b168 req-394a343d-fed3-4844-a89f-7e9f1f5fb7aa tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:22:10.739522 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-07023d1b-089b-4b49-a933-3ee432e5b168 req-394a343d-fed3-4844-a89f-7e9f1f5fb7aa tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=c1798ceb-b026-4db4-a559-b3b374a7e1a7 HTTP/1.1" status: 200  len: 943 time: 0.0885932
Jun 01 06:22:10.787859 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-07023d1b-089b-4b49-a933-3ee432e5b168 req-5a837293-245e-48f8-9772-7720b95ffe2c tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/security-groups?id=23991ca1-e8b0-4439-8006-3ce171b2642b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425596
Jun 01 06:22:10.812800 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 56c9fb4e-baeb-4c63-a801-0bbf2eec2068 details requested by agent hyperv_hv-cinder-79388 with host hv-cinder-79388 {{(pid=92231) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 06:22:10.949168 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 56c9fb4e-baeb-4c63-a801-0bbf2eec2068, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=56c9fb4e-baeb-4c63-a801-0bbf2eec2068,segment=NetworkSegment(8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e),segment_id=8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:22:10.963247 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Returning: {'device': '56c9fb4e-baeb-4c63-a801-0bbf2eec2068', 'network_id': '4d8cd222-c2f9-4d3c-934c-dba6dfa184ac', 'port_id': '56c9fb4e-baeb-4c63-a801-0bbf2eec2068', 'mac_address': 'fa:16:3e:df:f8:9b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 221, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd6fc7f9a-efe9-45b9-9679-8f49743dcb31', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92231) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 06:22:11.024978 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:11.043318 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 56c9fb4e-baeb-4c63-a801-0bbf2eec2068 {{(pid=92231) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 06:22:11.059280 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 56c9fb4e-baeb-4c63-a801-0bbf2eec2068, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=56c9fb4e-baeb-4c63-a801-0bbf2eec2068,segment=NetworkSegment(8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e),segment_id=8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:22:11.064120 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:11.065841 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-f077587f-7e03-4d69-871a-4b00fc2ca63d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:22:11.135046 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=56c9fb4e-baeb-4c63-a801-0bbf2eec2068,revision_number=4']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:22:11.139439 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:22:11.246971 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:11.267318 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['56c9fb4e-baeb-4c63-a801-0bbf2eec2068'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:22:11.971717 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d31f308f-38cc-4051-8177-3c738e8c9e6d req-fcd11d4a-ee14-46ab-813b-29ee0e40b3ae tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:22:11.973088 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d31f308f-38cc-4051-8177-3c738e8c9e6d req-fcd11d4a-ee14-46ab-813b-29ee0e40b3ae tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=c1798ceb-b026-4db4-a559-b3b374a7e1a7 HTTP/1.1" status: 200  len: 944 time: 0.0797532
Jun 01 06:22:12.017011 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-d31f308f-38cc-4051-8177-3c738e8c9e6d req-860ab352-2adf-4b97-9a4a-ca9ffcf6fd87 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/security-groups?id=23991ca1-e8b0-4439-8006-3ce171b2642b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0382867
Jun 01 06:22:12.351604 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-8a971077-ecd0-49e6-b71b-b7ec1b57aa93 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:12.828332 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 56c9fb4e-baeb-4c63-a801-0bbf2eec2068 up at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 06:22:12.912617 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning for port 56c9fb4e-baeb-4c63-a801-0bbf2eec2068 completed by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 06:22:12.917643 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.db.provisioning_blocks [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Provisioning complete for port 56c9fb4e-baeb-4c63-a801-0bbf2eec2068 triggered by entity L2. {{(pid=92231) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 06:22:12.918016 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8091423'] for port, provisioning_complete {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:13.038901 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-8110121'] for port, before_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:13.066000 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c1798ceb-b026-4db4-a559-b3b374a7e1a7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '56c9fb4e-baeb-4c63-a801-0bbf2eec2068'}] {{(pid=92231) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:22:13.068252 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4293ba61c338f505b5c050dd2228ded22a3d550eefa9a946e0413d5460591568" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3e374876-faaa-4685-9e46-3be5cc126716" -d '{"events": [{"server_uuid": "c1798ceb-b026-4db4-a559-b3b374a7e1a7", "name": "network-vif-plugged", "status": "completed", "tag": "56c9fb4e-baeb-4c63-a801-0bbf2eec2068"}]}' {{(pid=92231) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:22:13.076632 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] For port 56c9fb4e-baeb-4c63-a801-0bbf2eec2068, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=56c9fb4e-baeb-4c63-a801-0bbf2eec2068,segment=NetworkSegment(8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e),segment_id=8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e)] {{(pid=92231) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:22:13.081953 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8788496929428', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8788496545765', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8788496545814'] for port, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:13.084142 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-314174fd-c027-485f-84e5-d1cbcc7e71fb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:22:13.159888 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Pushing event updated for resources: {'Port': ['ID=56c9fb4e-baeb-4c63-a801-0bbf2eec2068,revision_number=5']} {{(pid=92231) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:22:13.164068 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG oslo_concurrency.lockutils [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=92231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:22:13.215576 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21f961f4-2da6-4787-bf40-a2a3cb387272 req-8030f410-4b1b-4a0d-8946-f70d1a409970 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:22:13.217788 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-21f961f4-2da6-4787-bf40-a2a3cb387272 req-8030f410-4b1b-4a0d-8946-f70d1a409970 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=c1798ceb-b026-4db4-a559-b3b374a7e1a7 HTTP/1.1" status: 200  len: 945 time: 0.0907695
Jun 01 06:22:13.259814 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:22:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dc54f814-242c-4450-bdc6-9df60c35fcf3 x-openstack-request-id: req-dc54f814-242c-4450-bdc6-9df60c35fcf3 {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:22:13.260128 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c1798ceb-b026-4db4-a559-b3b374a7e1a7", "name": "network-vif-plugged", "status": "completed", "tag": "56c9fb4e-baeb-4c63-a801-0bbf2eec2068", "code": 200}]} {{(pid=92231) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:22:13.260388 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-dc54f814-242c-4450-bdc6-9df60c35fcf3 {{(pid=92231) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:22:13.260789 dv-cinder-793885-1-iscsi neutron-server[92231]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c1798ceb-b026-4db4-a559-b3b374a7e1a7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '56c9fb4e-baeb-4c63-a801-0bbf2eec2068', 'code': 200}
Jun 01 06:22:13.278193 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-21f961f4-2da6-4787-bf40-a2a3cb387272 req-4c3c80f1-e3e2-4da2-9fa7-0b02d76eb6b6 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/security-groups?id=23991ca1-e8b0-4439-8006-3ce171b2642b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0512409
Jun 01 06:22:13.299151 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:13.490052 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec03858c-dd10-431a-b36b-f6a32eaa941b req-a6943176-95f1-4bb9-8d18-3ce94850ef26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:22:13.491433 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ec03858c-dd10-431a-b36b-f6a32eaa941b req-a6943176-95f1-4bb9-8d18-3ce94850ef26 service neutron] 10.222.0.48 "GET /v2.0/ports?device_id=c1798ceb-b026-4db4-a559-b3b374a7e1a7 HTTP/1.1" status: 200  len: 1098 time: 0.0692546
Jun 01 06:22:13.537151 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-ec03858c-dd10-431a-b36b-f6a32eaa941b req-29ec59ec-cbca-486d-90b3-7ccbeb1994be service neutron] 10.222.0.48 "GET /v2.0/security-groups?id=23991ca1-e8b0-4439-8006-3ce171b2642b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0369010
Jun 01 06:22:14.481244 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86083766-ef6f-4ba0-a8da-ae1ffcd76072 req-74e24a86-b9cf-4b23-a961-bc47abac3c1b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:22:14.483795 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-86083766-ef6f-4ba0-a8da-ae1ffcd76072 req-74e24a86-b9cf-4b23-a961-bc47abac3c1b tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=c1798ceb-b026-4db4-a559-b3b374a7e1a7 HTTP/1.1" status: 200  len: 945 time: 0.0861316
Jun 01 06:22:14.530967 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-86083766-ef6f-4ba0-a8da-ae1ffcd76072 req-d6c27b62-26ae-47d0-bd4d-fd286887d2bf tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/security-groups?id=23991ca1-e8b0-4439-8006-3ce171b2642b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0414367
Jun 01 06:22:15.398201 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:16.067424 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:35.723807 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:22:36.144637 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcea882b-cc07-4f12-8e14-32669e5ca7ac req-f4a9f81a-ac02-443e-b1e5-c9fbd3f8c011 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:22:36.146158 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bcea882b-cc07-4f12-8e14-32669e5ca7ac req-f4a9f81a-ac02-443e-b1e5-c9fbd3f8c011 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=c1798ceb-b026-4db4-a559-b3b374a7e1a7 HTTP/1.1" status: 200  len: 945 time: 0.2109351
Jun 01 06:22:36.206681 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-bcea882b-cc07-4f12-8e14-32669e5ca7ac req-e5dc259d-22f9-4021-8001-377cf1cce6ed tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/security-groups?id=23991ca1-e8b0-4439-8006-3ce171b2642b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0544562
Jun 01 06:22:37.441777 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe0ecfa5-18ec-4f7c-90fd-b61dc9f13d1e req-05a87913-18a4-466c-9f15-c18e2e32bb44 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:22:37.443260 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fe0ecfa5-18ec-4f7c-90fd-b61dc9f13d1e req-05a87913-18a4-466c-9f15-c18e2e32bb44 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=c1798ceb-b026-4db4-a559-b3b374a7e1a7 HTTP/1.1" status: 200  len: 945 time: 0.1248238
Jun 01 06:22:37.504665 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-fe0ecfa5-18ec-4f7c-90fd-b61dc9f13d1e req-0ab45789-6704-4415-a025-e9943be75631 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/security-groups?id=23991ca1-e8b0-4439-8006-3ce171b2642b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0520468
Jun 01 06:22:37.518978 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efa5cc90-f6e2-4cd5-a964-2e255aca5e92 req-02980762-cd67-47b9-ad6e-57bb168aebea tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92229) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 06:22:37.520495 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-efa5cc90-f6e2-4cd5-a964-2e255aca5e92 req-02980762-cd67-47b9-ad6e-57bb168aebea tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.48 "GET /v2.0/ports?device_id=c1798ceb-b026-4db4-a559-b3b374a7e1a7 HTTP/1.1" status: 200  len: 945 time: 0.1334362
Jun 01 06:22:37.686674 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-efa5cc90-f6e2-4cd5-a964-2e255aca5e92 req-be65f4da-d511-44f4-8835-d66b5b2ce009 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Deleting port 56c9fb4e-baeb-4c63-a801-0bbf2eec2068 {{(pid=92229) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 06:22:37.687589 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-efa5cc90-f6e2-4cd5-a964-2e255aca5e92 req-be65f4da-d511-44f4-8835-d66b5b2ce009 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8788496927299'] for port, before_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:37.832952 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.db [req-efa5cc90-f6e2-4cd5-a964-2e255aca5e92 req-be65f4da-d511-44f4-8835-d66b5b2ce009 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] For port 56c9fb4e-baeb-4c63-a801-0bbf2eec2068, host hv-cinder-79388, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79388',level=0,port_id=56c9fb4e-baeb-4c63-a801-0bbf2eec2068,segment=NetworkSegment(8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e),segment_id=8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e)] {{(pid=92229) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 06:22:37.833463 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-efa5cc90-f6e2-4cd5-a964-2e255aca5e92 req-be65f4da-d511-44f4-8835-d66b5b2ce009 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-744475'] for port, precommit_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:37.966477 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.plugins.ml2.plugin [req-efa5cc90-f6e2-4cd5-a964-2e255aca5e92 req-be65f4da-d511-44f4-8835-d66b5b2ce009 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Calling delete_port for 56c9fb4e-baeb-4c63-a801-0bbf2eec2068 owned by compute:nova {{(pid=92229) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 06:22:38.095314 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-efa5cc90-f6e2-4cd5-a964-2e255aca5e92 req-be65f4da-d511-44f4-8835-d66b5b2ce009 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-8114174', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91464', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8788496929446', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8788496545756', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2077410'] for port, after_delete {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:38.101766 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-a154816f-b520-4061-88fc-430db063b471 tempest-DeleteServersTestJSON-1164877680 tempest-DeleteServersTestJSON-1164877680-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:22:38.107395 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.db [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] get_ports_and_sgs() called for port_ids ['56c9fb4e-baeb-4c63-a801-0bbf2eec2068'] {{(pid=92231) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 06:22:38.150363 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be65f4da-d511-44f4-8835-d66b5b2ce009 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Pushing event deleted for resources: {'Port': ['ID=56c9fb4e-baeb-4c63-a801-0bbf2eec2068,revision_number=None']} {{(pid=92229) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:22:38.153603 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG oslo_concurrency.lockutils [None req-be65f4da-d511-44f4-8835-d66b5b2ce009 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:22:38.228298 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.db.l3_dvrscheduler_db [req-efa5cc90-f6e2-4cd5-a964-2e255aca5e92 req-be65f4da-d511-44f4-8835-d66b5b2ce009 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] No DVR routers for this DVR port 56c9fb4e-baeb-4c63-a801-0bbf2eec2068 on host hv-cinder-79388 {{(pid=92229) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 06:22:38.230786 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron_lib.callbacks.manager [req-efa5cc90-f6e2-4cd5-a964-2e255aca5e92 req-be65f4da-d511-44f4-8835-d66b5b2ce009 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-40457'] for port, before_response {{(pid=92229) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:38.233393 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c1798ceb-b026-4db4-a559-b3b374a7e1a7', 'name': 'network-vif-deleted', 'tag': '56c9fb4e-baeb-4c63-a801-0bbf2eec2068'}] {{(pid=92229) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 06:22:38.236320 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.25/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ff099284d9bee332971e126212429814a67743b0c285d7b64da1dcd289a0af85" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7b785623-c848-4ef1-9503-05679f47f5f2" -d '{"events": [{"server_uuid": "c1798ceb-b026-4db4-a559-b3b374a7e1a7", "name": "network-vif-deleted", "tag": "56c9fb4e-baeb-4c63-a801-0bbf2eec2068"}]}' {{(pid=92229) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 06:22:38.251346 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-efa5cc90-f6e2-4cd5-a964-2e255aca5e92 req-be65f4da-d511-44f4-8835-d66b5b2ce009 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.48 "DELETE /v2.0/ports/56c9fb4e-baeb-4c63-a801-0bbf2eec2068 HTTP/1.1" status: 204  len: 173 time: 0.7250941
Jun 01 06:22:38.335279 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-64cd4c34-39c2-4239-865c-7ad582d3913e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:38.341518 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 06:22:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-46c1ea5a-5c84-493c-97e5-104b07225f27 x-openstack-request-id: req-46c1ea5a-5c84-493c-97e5-104b07225f27 {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 06:22:38.341939 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c1798ceb-b026-4db4-a559-b3b374a7e1a7", "name": "network-vif-deleted", "tag": "56c9fb4e-baeb-4c63-a801-0bbf2eec2068", "status": "completed", "code": 200}]} {{(pid=92229) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 06:22:38.342301 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.25/compute/v2.1/os-server-external-events used request id req-46c1ea5a-5c84-493c-97e5-104b07225f27 {{(pid=92229) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 06:22:38.342796 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c1798ceb-b026-4db4-a559-b3b374a7e1a7', 'name': 'network-vif-deleted', 'tag': '56c9fb4e-baeb-4c63-a801-0bbf2eec2068', 'status': 'completed', 'code': 200}
Jun 01 06:22:38.683640 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-767bec5b-f732-4e3c-9862-e1454fe5e035 req-1877db79-3839-4cc9-983f-18352c4630c6 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Synchronizing usage tracker for tenant:e4915685ec04413092ab2058fb1fa324 on resource:port {{(pid=92229) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 06:22:38.701294 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.quota.resource [req-767bec5b-f732-4e3c-9862-e1454fe5e035 req-1877db79-3839-4cc9-983f-18352c4630c6 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] Unset dirty status for tenant:e4915685ec04413092ab2058fb1fa324 on resource:port {{(pid=92229) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 06:22:38.702705 dv-cinder-793885-1-iscsi neutron-server[92229]: INFO neutron.wsgi [req-767bec5b-f732-4e3c-9862-e1454fe5e035 req-1877db79-3839-4cc9-983f-18352c4630c6 tempest-VolumesSnapshotTestJSON-1434654188 tempest-VolumesSnapshotTestJSON-1434654188-project] 10.222.0.25 "GET /v2.0/ports?device_id=c1798ceb-b026-4db4-a559-b3b374a7e1a7 HTTP/1.1" status: 200  len: 210 time: 0.0702486
Jun 01 06:22:41.016858 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 56c9fb4e-baeb-4c63-a801-0bbf2eec2068 no longer exists at agent hyperv_hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 06:22:41.052409 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.plugin [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] No Port match for: 56c9fb4e-baeb-4c63-a801-0bbf2eec2068 {{(pid=92231) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 06:22:41.052752 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron.plugins.ml2.rpc [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Device 56c9fb4e-baeb-4c63-a801-0bbf2eec2068 not bound to the agent host hv-cinder-79388 {{(pid=92231) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 06:22:41.253688 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:42.357035 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-17bf784c-0399-4cb8-addb-021216f231e5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:43.302839 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:45.398470 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:22:46.093880 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:05.354001 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 42382) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:23:05.413872 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.db.db_base_plugin_v2 [None req-95435810-4dbe-4374-a471-50888c49acd9 admin admin] Deleting subnet d6fc7f9a-efe9-45b9-9679-8f49743dcb31 {{(pid=92230) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 06:23:05.416792 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-95435810-4dbe-4374-a471-50888c49acd9 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:05.471027 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-95435810-4dbe-4374-a471-50888c49acd9 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2178887'] for subnet, precommit_delete_associations {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:05.526023 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-95435810-4dbe-4374-a471-50888c49acd9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8086245'] for subnet, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:05.864393 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-95435810-4dbe-4374-a471-50888c49acd9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8087120', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-91539', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-581099', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2445502', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1981527'] for subnet, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:05.869177 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-b8b15a96-c8e0-4c74-a8c6-b27aefb0acf6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:23:05.903669 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95435810-4dbe-4374-a471-50888c49acd9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d6fc7f9a-efe9-45b9-9679-8f49743dcb31,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:23:05.906514 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-95435810-4dbe-4374-a471-50888c49acd9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for subnet, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:05.915519 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95435810-4dbe-4374-a471-50888c49acd9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:23:05.915926 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95435810-4dbe-4374-a471-50888c49acd9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:23:05.916296 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95435810-4dbe-4374-a471-50888c49acd9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:23:05.916661 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95435810-4dbe-4374-a471-50888c49acd9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:23:05.917019 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95435810-4dbe-4374-a471-50888c49acd9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:23:05.917381 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95435810-4dbe-4374-a471-50888c49acd9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:23:05.917736 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95435810-4dbe-4374-a471-50888c49acd9 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:23:05.918090 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95435810-4dbe-4374-a471-50888c49acd9 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:23:05.918448 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95435810-4dbe-4374-a471-50888c49acd9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:23:05.918797 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95435810-4dbe-4374-a471-50888c49acd9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:23:05.919151 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95435810-4dbe-4374-a471-50888c49acd9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:23:05.919499 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95435810-4dbe-4374-a471-50888c49acd9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793885-1-iscsi {{(pid=92230) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 06:23:05.922977 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-95435810-4dbe-4374-a471-50888c49acd9 admin admin] 10.222.0.25 "DELETE /v2.0/subnets/d6fc7f9a-efe9-45b9-9679-8f49743dcb31 HTTP/1.1" status: 204  len: 168 time: 0.5680079
Jun 01 06:23:05.924396 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-95435810-4dbe-4374-a471-50888c49acd9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:23:05.926269 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 42386) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:23:06.031417 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d6c7ac0e-bb6e-4d54-9fa4-4f77ca0f2640 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8063377'] for network, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:06.159553 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d6c7ac0e-bb6e-4d54-9fa4-4f77ca0f2640 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8093290', 'neutron.services.segments.db._delete_segments_for_network-8788497006300'] for network, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:06.172451 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-d6c7ac0e-bb6e-4d54-9fa4-4f77ca0f2640 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fe3b21296d0>,) {'filters': {'network_id': ['4d8cd222-c2f9-4d3c-934c-dba6dfa184ac']}} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:23:06.184795 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-d6c7ac0e-bb6e-4d54-9fa4-4f77ca0f2640 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b21296d0>, '8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e') {'for_net_delete': True} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:23:06.185087 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.services.segments.db [None req-d6c7ac0e-bb6e-4d54-9fa4-4f77ca0f2640 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fe3b21296d0>, '8e54c68a-ff2a-484b-a63b-2ba72b8b1d0e') {} {{(pid=92230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 06:23:06.197907 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d6c7ac0e-bb6e-4d54-9fa4-4f77ca0f2640 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8788497014941', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2178892'] for segment, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:06.215509 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d6c7ac0e-bb6e-4d54-9fa4-4f77ca0f2640 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018'] for segment, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:06.221988 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d6c7ac0e-bb6e-4d54-9fa4-4f77ca0f2640 admin admin] Releasing vlan 221 on physical network physnet1 to pool {{(pid=92230) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 06:23:06.222386 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d6c7ac0e-bb6e-4d54-9fa4-4f77ca0f2640 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8088018', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2416152'] for segment, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]: Traceback (most recent call last):
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:     timer()
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:     cb(*args, **kw)
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:     return func(*args, **kwargs)
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:     self._notify()
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:     self.callback(batched_events)
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:     event.method(event)
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:     return f(self, *a, **k)
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self._get(url).json()
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:     return self.request(url, 'GET', **kwargs)
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 06:23:06.235546 dv-cinder-793885-1-iscsi neutron-server[92230]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 06:23:06.312474 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d6c7ac0e-bb6e-4d54-9fa4-4f77ca0f2640 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8093283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-724289', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-581104', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-745674'] for network, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:06.317123 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-78cefa49-f8b8-4fe0-892c-e41ac130ee89 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:23:06.330743 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-d6c7ac0e-bb6e-4d54-9fa4-4f77ca0f2640 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-581077'] for network, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:06.341628 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6c7ac0e-bb6e-4d54-9fa4-4f77ca0f2640 admin admin] Pushing event deleted for resources: {'Network': ['ID=4d8cd222-c2f9-4d3c-934c-dba6dfa184ac,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:23:06.344827 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-d6c7ac0e-bb6e-4d54-9fa4-4f77ca0f2640 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:23:06.350140 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-d6c7ac0e-bb6e-4d54-9fa4-4f77ca0f2640 admin admin] 10.222.0.25 "DELETE /v2.0/networks/4d8cd222-c2f9-4d3c-934c-dba6dfa184ac HTTP/1.1" status: 204  len: 168 time: 0.4229147
Jun 01 06:23:06.523589 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 42392) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:23:06.572342 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-021c729e-abdc-43ea-88cf-c826fd5f10c5 admin admin] 10.222.0.25 "GET /v2.0/security-groups?tenant_id=e4915685ec04413092ab2058fb1fa324&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0474668
Jun 01 06:23:06.574664 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [-] (92230) accepted ('10.222.0.25', 42396) {{(pid=92230) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 06:23:06.636808 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-42fbea18-4ae1-4396-b067-26b64863329b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:06.663634 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-42fbea18-4ae1-4396-b067-26b64863329b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:06.713628 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-42fbea18-4ae1-4396-b067-26b64863329b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-724325'] for security_group, after_delete {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:06.717379 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-8761f761-9fd8-4560-b83c-1fd665e6ab0c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 06:23:06.731961 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42fbea18-4ae1-4396-b067-26b64863329b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=23991ca1-e8b0-4439-8006-3ce171b2642b,revision_number=None']} {{(pid=92230) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 06:23:06.734317 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG oslo_concurrency.lockutils [None req-42fbea18-4ae1-4396-b067-26b64863329b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 06:23:06.746133 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron_lib.callbacks.manager [None req-42fbea18-4ae1-4396-b067-26b64863329b admin admin] Notify callbacks [] for security_group, before_response {{(pid=92230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:06.749724 dv-cinder-793885-1-iscsi neutron-server[92230]: INFO neutron.wsgi [None req-42fbea18-4ae1-4396-b067-26b64863329b admin admin] 10.222.0.25 "DELETE /v2.0/security-groups/23991ca1-e8b0-4439-8006-3ce171b2642b HTTP/1.1" status: 204  len: 168 time: 0.1717017
Jun 01 06:23:08.341112 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-b6a6f369-ff26-4f73-80bb-348c286d6871 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:11.246334 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:12.350265 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-8438662e-7f8f-4bb5-b029-9db5cdaa85bb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:12.723972 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:23:13.304675 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:15.401100 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:16.088605 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:38.344245 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-21fce620-aee6-440e-b2ae-5b435ad582b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:41.249459 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:42.353745 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-20d0a2ce-ab75-4456-9b81-fa00f84d7994 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:43.307585 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:45.403386 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:46.088390 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:23:49.723389 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:24:08.345631 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-ba99509a-7fe2-4247-98af-8f36469c4844 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:24:11.252291 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:24:12.354868 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-9a722ecb-3fd7-4929-80ff-838b09c577c7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:24:13.311133 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:24:15.406037 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:24:16.086139 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:24:26.721990 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:24:38.347573 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-927f6980-6a0b-4faf-9794-649cd8b16df5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:24:41.257285 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:24:42.356076 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-aba95977-2ce2-47a5-b08d-6e6573d7533a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:24:43.313347 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:24:45.408984 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:24:46.093935 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:25:03.721013 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:25:08.352551 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-705fba6f-5b08-4527-a123-74d1067c92b8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:25:11.260917 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:25:12.357857 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-7e8c51c3-0e2f-4f76-8ac7-3b0373cb400f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:25:13.316656 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:25:15.413317 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:25:16.116709 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:25:38.388667 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4e73a5a7-91c4-4735-94d3-153697fd930f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:25:40.719609 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:25:41.268731 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:25:42.359815 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fdfa2416-e0b0-4011-87b7-70fafb87c2ec None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:25:43.320994 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:25:45.414151 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:25:46.108030 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:26:08.361149 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-9fe1fa6c-0348-4b36-be01-c11acf53ee9c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:26:11.265239 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:26:12.362703 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-eceda98f-0eb2-48ed-9763-0c994c661768 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:26:13.324076 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:26:15.418853 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:26:16.120440 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:26:17.718284 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:26:38.363971 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-05c49c54-954a-4bca-9a2d-1b0deae600c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:26:41.268029 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:26:42.367796 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-8fc187ee-9eb7-4829-96b8-d986932e1798 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:26:43.333763 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:26:45.422098 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:26:46.125332 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:26:54.717987 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:27:08.365792 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-1e15863a-1b95-4007-ba0a-8e336a617c05 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:27:10.256536 dv-cinder-793885-1-iscsi neutron-server[92229]: DEBUG neutron.wsgi [req-a8b31452-ab53-441c-a39e-51917485c258 req-fc80eef4-9880-470d-93b9-00b6421b5c5a service neutron] (92229) timed out ('10.222.0.48', 58121) {{(pid=92229) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
Jun 01 06:27:10.736540 dv-cinder-793885-1-iscsi neutron-server[92230]: DEBUG neutron.wsgi [req-2d0ad684-3cc2-4215-8332-6a05f78c87ca req-92f09bd3-18f5-4db7-a03e-ed8a8c53f952 service neutron] (92230) timed out ('10.222.0.48', 58072) {{(pid=92230) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
Jun 01 06:27:11.272306 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:27:12.371135 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-c58f1195-1131-4cc5-bfea-37a676b7e24f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:27:13.330228 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:27:15.425053 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:27:16.130899 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:27:31.718063 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:27:38.368081 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-8d8d3696-c243-464b-895b-f9d684e46485 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:27:41.274536 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:27:42.375742 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-e113c290-5ed4-4944-a3c9-d7ffb9744bb4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:27:43.332818 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:27:45.427619 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-4af9a0d4-9bc4-4e4e-9d05-247c59789d48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:27:46.134452 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-d556e41d-7389-4230-9095-9b0404f5bfa9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:28:08.370210 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-f44ff9d6-1d9f-49a4-a659-74bd86f43815 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:28:08.717635 dv-cinder-793885-1-iscsi neutron-server[92232]: DEBUG neutron.db.agents_db [None req-30a47045-f855-4777-bcf0-93224579eccf None None] Agent healthcheck: found 6 active agents {{(pid=92232) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 06:28:11.277802 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-035cd35b-18a4-4f10-a4b8-fda896223c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:28:12.378955 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-60a98c12-aa41-487f-90cd-32b49047691c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 06:28:13.335314 dv-cinder-793885-1-iscsi neutron-server[92231]: DEBUG neutron_lib.callbacks.manager [None req-fe2aeacc-cc07-4992-b3a7-da3b3abab50e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8788497006318', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8090532'] for agent, after_update {{(pid=92231) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}